00000001:02000400:1.0F:1789302331.044662:0:2958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789302349.624749:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789302351.726360:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 605 MB/s 00000001:01000000:2.0:1789302351.976497:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 663 MB/s 00000001:01000000:2.0:1789302352.226522:0:3240:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4459 MB/s 00000020:02000000:0.0F:1789302353.140995:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ge5a3bee 00000400:02000000:2.0:1789302354.357166:0:3287:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.142@tcp [8/256/0/180] 00008000:02000000:0.0:1789302358.191092:0:3437:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789302410.169045:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789302421.427694:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789302421.427704:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789302421.428083:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000445fb0f7 00000080:02000400:3.0:1789302421.428097:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789302421.434785:0:5825:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789302421.434806:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789302421.437841:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006ad465c7) 00000020:00000080:2.0:1789302421.437884:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789302421.484027:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789302421.486000:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789302421.541099:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789302421.541143:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789302421.541164:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789302421.541215:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789302421.541404:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789302421.544482:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789302421.544498:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789302421.544514:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f1120a 00000020:01000004:2.0:1789302421.544526:0:5825:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789302421.544532:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789302421.544607:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000445fb0f7 from MGS 00000020:01000004:2.0:1789302421.544660:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789302421.544677:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000df60fcc6) 00000020:00000080:2.0:1789302421.544691:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789302421.544798:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000445fb0f7 from MGS, refs=2 00080000:01000000:2.0:1789302421.544805:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789302421.544812:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f11218 00000100:00100000:2.0:1789302421.545119:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789302421.546106:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789302421.546117:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789302421.548935:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789302421.548950:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789302421.552483:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302421.553224:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789302421.553233:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789302421.554949:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789302421.554964:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789302421.557368:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789302421.557383:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789302421.559482:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302421.559489:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302421.559492:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302421.559697:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302421.559701:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302421.559702:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302421.561197:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789302421.563879:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789302421.814768:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2133 MB/s 00000001:01000000:3.0:1789302422.064347:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3915 MB/s 00000001:01000000:3.0:1789302422.319198:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 472 MB/s 00000001:01000000:3.0:1789302422.571211:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 630 MB/s 00080000:10000000:2.0:1789302422.580026:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1789302422.605745:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789302422.617933:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789302422.618028:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789302422.618032:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789302422.625543:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789302422.625654:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789302422.625706:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789302422.625965:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789302422.625996:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789302422.626361:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302422.626519:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789302422.626526:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789302422.627541:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789302422.627550:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789302422.628172:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789302422.628179:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789302422.630108:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789302422.630130:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.142@tcp' 00000020:01000004:3.0:1789302422.630132:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789302422.630181:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.142@tcp (typ=mgc) 00000020:00000080:3.0:1789302422.630200:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.142@tcp (00000000401aab9c) 00000020:00000080:3.0:1789302422.630216:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789302422.630364:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001ec50aa6@MGC192.168.203.142@tcp: add connection 192.168.203.142@tcp at head 00010000:00010000:3.0:1789302422.630523:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.142@tcp-0 is initialized 00000040:01000000:3.0:1789302422.630530:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789302422.630780:0:5841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789302422.637632:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789302422.638079:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.142@tcp (uuid 8df8e325-951a-4604-89fa-82b64ca867d0) 00000020:00000080:1.0:1789302422.638102:0:5825:0:(genops.c:1384:class_connect()) connect: client 8df8e325-951a-4604-89fa-82b64ca867d0, cookie 0x20be524657f11226 00000100:00080000:1.0:1789302422.638115:0:5825:0:(import.c:545:import_select_connection()) MGC192.168.203.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302422.638126:0:5825:0:(import.c:666:import_select_connection()) MGC192.168.203.142@tcp: import 000000001ec50aa6 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789302422.638169:0:5825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000038bfa5b0 x1876219505148032/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302422.638198:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8df8e325-951a-4604-89fa-82b64ca867d0->MGS 00000020:01000004:1.0:1789302422.638220:0:5825:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789302422.638243:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789302422.638275:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003c96b8fe) 00000020:00000080:1.0:1789302422.638310:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789302422.645181:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038bfa5b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8df8e325-951a-4604-89fa-82b64ca867d0:3302:1876219505148032:0@lo:250: 00000100:00100000:2.0:1789302422.645314:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302422.647712:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505148032 00000100:00100000:0.0:1789302422.647726:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505148032 00000100:00100000:0.0:1789302422.647779:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302422.647786:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ab19ae5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1876219505148032:12345-0@lo:250: 00010000:00080000:0.0:1789302422.647813:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8df8e325-951a-4604-89fa-82b64ca867d0@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:0.0:1789302422.647842:0:5838:0:(genops.c:1384:class_connect()) connect: client 8df8e325-951a-4604-89fa-82b64ca867d0, cookie 0x20be524657f11234 00000100:00080000:0.0:1789302422.648102:0:5838:0:(import.c:65:import_set_state_nolock()) 00000000090c74a1 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302422.648191:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ab19ae5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+5:3302:x1876219505148032:12345-0@lo:250: Request processed in 404us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302422.648199:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302422.650799:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789302422.650816:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.142@tcp: connect to target with instance 0 00000100:00080000:2.0:1789302422.650825:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789302422.650830:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789302422.650834:0:3302:0:(import.c:65:import_set_state_nolock()) 000000001ec50aa6 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789302422.650839:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789302422.650850:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789302422.650857:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038bfa5b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8df8e325-951a-4604-89fa-82b64ca867d0:3302:1876219505148032:0@lo:250: 00000100:00100000:1.0:1789302422.672677:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302422.672886:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789302422.672893:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789302422.686092:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789302422.686116:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789302422.695401:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302422.695417:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789302422.702554:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302422.702820:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789302422.702828:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789302422.713960:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789302422.713980:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789302422.832675:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302422.834039:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789302422.834052:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789302422.840345:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789302422.840366:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789302422.841447:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302422.841685:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789302422.841701:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789302422.842604:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789302422.842613:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789302422.844661:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302422.844885:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789302422.844891:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789302422.846384:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302422.846403:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789302422.848654:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302422.850171:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302422.850181:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789302422.855058:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302422.855364:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789302422.929457:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302422.929736:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789302422.929743:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789302422.932686:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789302422.932705:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789302422.941428:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789302422.948487:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789302422.951573:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789302422.951615:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789302422.951623:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789302422.951824:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789302422.951877:0:5825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.142@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789302422.951882:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789302422.951883:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302422.951890:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302422.951891:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302422.951892:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302422.951893:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302422.951894:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302422.951895:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302422.951896:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302422.951898:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302422.951899:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302422.951901:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302422.951903:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789302422.951906:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789302422.951907:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302422.951907:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302422.951908:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302422.951909:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302422.951910:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302422.951911:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302422.951912:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302422.951912:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302422.951913:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302422.951914:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302422.951914:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302422.951961:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789302422.951986:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148160:0@lo:253: 00000100:00100000:0.0:1789302422.952083:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302422.952153:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000541bc906 going to sleep for 11 seconds 00000100:00100000:1.0:1789302422.952275:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505148160 00000100:00100000:1.0:1789302422.952409:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505148160 00000100:00100000:1.0:1789302422.952468:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302422.952477:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000994fd95e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+5:5825:x1876219505148160:12345-0@lo:253: 20000000:01000000:1.0:1789302422.952538:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789302422.952541:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789302422.953454:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789302422.953538:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789302422.953910:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302422.968253:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789302422.981204:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789302422.981215:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789302422.981221:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789302422.981224:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789302422.981251:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789302422.981551:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302422.981806:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789302422.981820:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789302422.981872:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789302422.982072:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789302422.982114:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789302422.982207:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789302422.982216:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789302422.982273:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789302422.982281:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789302422.982340:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789302422.982348:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789302422.982379:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789302422.982448:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789302422.982490:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789302422.982495:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789302422.982507:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302422.982734:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789302422.982744:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789302422.982779:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789302422.982816:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789302422.982866:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789302422.982877:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789302422.986557:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789302422.986583:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789302422.986659:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789302422.986702:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789302422.986738:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789302422.986756:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789302422.986897:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789302422.986906:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789302422.986941:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789302422.986972:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789302422.987115:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789302422.987162:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789302422.987169:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789302422.987906:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789302422.993359:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789302422.993409:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.142@tcp for mdt 20000000:01000000:2.0:1789302422.993429:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:2.0:1789302422.993470:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789302422.993478:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789302422.993507:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789302422.993514:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:2.0:1789302422.993559:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789302422.993570:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789302422.993603:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789302422.993632:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789302422.993713:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789302422.993716:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789302422.993721:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789302422.993737:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789302422.993740:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789302422.993772:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789302422.993775:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789302423.003332:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789302423.004813:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789302423.004879:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789302423.006150:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1789302423.006187:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789302423.006190:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789302423.009667:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789302423.011619:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789302423.011990:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789302423.012030:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789302423.012063:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789302423.012067:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789302423.012074:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789302423.012077:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789302423.012083:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789302423.012092:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789302423.016456:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789302423.019587:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789302423.035372:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789302423.035437:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789302423.035524:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789302423.035549:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789302423.035574:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035595:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035607:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035614:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035620:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035628:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035634:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000044fee5 already unused, calling callback (00000000109891ae) 00010000:00010000:2.0:1789302423.035638:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035645:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035660:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035691:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.035698:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000044fee5/0x20be524657f1123b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789302423.035718:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789302423.417079:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000994fd95e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+5:5825:x1876219505148160:12345-0@lo:253: Request processed in 464590us (464984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302423.417107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302423.417219:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148160:0@lo:253: 10000000:01000000:0.0:1789302423.417240:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789302423.417244:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789302423.417246:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302423.417248:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302423.417249:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789302423.417251:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302423.417252:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302423.417281:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302423.417283:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302423.417377:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789302423.417379:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302423.417380:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789302423.417405:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000445fb0f7 from lustre-MDT0000 10000000:01000000:0.0:1789302423.417442:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789302423.417446:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789302423.417451:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a690a593380 10000000:01000000:0.0:1789302423.417518:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789302423.417530:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a690a593380 from 1 10000000:01000000:0.0:1789302423.417533:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789302423.417582:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 000000003cf5a033/0x20be524657f11242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.417595:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 000000003cf5a033/0x20be524657f11242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.417605:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 000000003cf5a033/0x20be524657f11242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.417629:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148288:0@lo:101: 00000100:00100000:0.0:1789302423.417676:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.417926:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034a3a450 going to sleep for 11 seconds 00000100:00100000:3.0:1789302423.418007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505148288 00000100:00100000:3.0:1789302423.418016:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505148288 00000100:00100000:3.0:1789302423.418142:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302423.418152:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a600945 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+5:5825:x1876219505148288:12345-0@lo:101: 00010000:00010000:3.0:1789302423.418169:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302423.418185:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c42183e5/0x20be524657f11249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11242 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.418213:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c42183e5/0x20be524657f11249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11242 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.418225:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c42183e5/0x20be524657f11249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11242 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.418233:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c42183e5, rc 0) 00000100:00100000:3.0:1789302423.418372:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a600945 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+6:5825:x1876219505148288:12345-0@lo:101: Request processed in 221us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302423.418379:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302423.418469:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148288:0@lo:101: 00010000:00010000:0.0:1789302423.418485:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 000000003cf5a033/0x20be524657f11242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.418495:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 000000003cf5a033/0x20be524657f11242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.418552:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148416:0@lo:501: 00000100:00100000:0.0:1789302423.418591:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.423804:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034a3a450 going to sleep for 11 seconds 00000100:00100000:2.0:1789302423.425691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505148416 00000100:00100000:2.0:1789302423.425715:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505148416 00000100:00100000:3.0:1789302423.426960:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302423.426983:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000586a7de5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+6:5825:x1876219505148416:12345-0@lo:501: 00000100:00100000:3.0:1789302423.427568:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000586a7de5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+6:5825:x1876219505148416:12345-0@lo:501: Request processed in 593us (8973us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302423.427579:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302423.428120:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148416:0@lo:501: 10000000:01000000:0.0:1789302423.428177:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789302423.428202:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 000000003cf5a033/0x20be524657f11242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.428214:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 000000003cf5a033/0x20be524657f11242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302423.428225:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6905909800 10000000:01000000:0.0:1789302423.428232:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789302423.428236:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a6905909800 10000000:01000000:0.0:1789302423.428239:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789302423.428243:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a6905909800 from 1 10000000:01000000:0.0:1789302423.428246:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789302423.428324:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000b7e96739/0x20be524657f11250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.428333:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000b7e96739/0x20be524657f11250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.428344:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000b7e96739/0x20be524657f11250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.428366:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148544:0@lo:101: 00000100:00100000:0.0:1789302423.428417:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.429490:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034a3a450 going to sleep for 11 seconds 00000100:00100000:1.0:1789302423.429763:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505148544 00000100:00100000:1.0:1789302423.429775:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505148544 00000100:00100000:1.0:1789302423.429843:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302423.429852:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b39f53be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+6:5825:x1876219505148544:12345-0@lo:101: 00010000:00010000:1.0:1789302423.429871:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302423.429895:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097bab715/0x20be524657f11257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11250 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302423.429945:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097bab715/0x20be524657f11257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11250 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302423.429955:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097bab715/0x20be524657f11257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11250 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302423.429965:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097bab715, rc 0) 00000100:00100000:1.0:1789302423.430028:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b39f53be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+7:5825:x1876219505148544:12345-0@lo:101: Request processed in 177us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302423.430034:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302423.431201:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148544:0@lo:101: 00010000:00010000:0.0:1789302423.431266:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000b7e96739/0x20be524657f11250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.431277:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000b7e96739/0x20be524657f11250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302423.431434:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789302423.431540:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000b7e96739/0x20be524657f11250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.431550:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000b7e96739/0x20be524657f11250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302423.431558:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789302423.431564:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789302423.431570:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a6905909800 10000000:01000000:0.0:1789302423.431573:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789302423.431577:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789302423.431580:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789302423.431618:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000a7005385/0x20be524657f1125e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.431626:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000a7005385/0x20be524657f1125e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.431635:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000a7005385/0x20be524657f1125e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.431659:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148672:0@lo:101: 00000100:00100000:0.0:1789302423.431723:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.431776:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034a3a450 going to sleep for 11 seconds 00000100:00100000:2.0:1789302423.438981:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505148672 00000100:00100000:2.0:1789302423.439005:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505148672 00000100:00100000:2.0:1789302423.439091:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302423.439103:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e79511c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+7:5825:x1876219505148672:12345-0@lo:101: 00010000:00010000:2.0:1789302423.439129:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302423.439154:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000044fee5/0x20be524657f11265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1125e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.439191:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000044fee5/0x20be524657f11265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1125e expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.439202:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000044fee5/0x20be524657f11265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1125e expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.439212:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000044fee5, rc 0) 00000100:00100000:2.0:1789302423.439354:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e79511c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+8:5825:x1876219505148672:12345-0@lo:101: Request processed in 253us (7631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302423.439382:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302423.440177:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148672:0@lo:101: 00010000:00010000:0.0:1789302423.440204:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000a7005385/0x20be524657f1125e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.440216:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000a7005385/0x20be524657f1125e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.440400:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148800:0@lo:501: 00000100:00100000:0.0:1789302423.440514:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.440577:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034a3a450 going to sleep for 11 seconds 00000100:00100000:2.0:1789302423.440644:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505148800 00000100:00100000:2.0:1789302423.440652:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505148800 00000100:00100000:2.0:1789302423.440690:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302423.440697:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000777dd30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+8:5825:x1876219505148800:12345-0@lo:501: 00000100:00100000:2.0:1789302423.441092:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000777dd30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+9:5825:x1876219505148800:12345-0@lo:501: Request processed in 394us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302423.441099:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302423.441190:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148800:0@lo:501: 00000100:00100000:0.0:1789302423.441223:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148928:0@lo:503: 00000100:00100000:0.0:1789302423.441276:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.441554:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034a3a450 going to sleep for 11 seconds 00000100:00100000:3.0:1789302423.446673:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505148928 00000100:00100000:3.0:1789302423.446700:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505148928 00000100:00100000:3.0:1789302423.446925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789302423.446938:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c94c5522 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+9:5825:x1876219505148928:12345-0@lo:503: 00000100:00100000:3.0:1789302423.447350:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c94c5522 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+9:5825:x1876219505148928:12345-0@lo:503: Request processed in 415us (6073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302423.447359:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302423.447985:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022ec5762 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505148928:0@lo:503: 00000100:00100000:1.0:1789302423.448273:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000046174a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:5868:1876219505149056:0@lo:502: 00000100:00100000:1.0:1789302423.448377:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302423.456998:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505149056 00000100:00100000:2.0:1789302423.457056:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505149056 00000100:00100000:1.0:1789302423.457129:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d443fed7 going to sleep for 11 seconds 00000100:00100000:1.0:1789302423.457526:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302423.457539:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067bd9d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+9:5868:x1876219505149056:12345-0@lo:502: 00000100:00100000:1.0:1789302423.459600:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067bd9d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+9:5868:x1876219505149056:12345-0@lo:502: Request processed in 2052us (11211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302423.459619:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302423.459744:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000046174a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:5868:1876219505149056:0@lo:502: 00000020:01000000:1.0:1789302423.459799:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302423.459817:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302423.459960:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789302423.459968:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789302423.459972:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302423.460003:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000af518d73) 00000020:00000080:1.0:1789302423.460031:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789302423.460043:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789302423.460166:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789302423.460176:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f11273 00000020:00000080:1.0:1789302423.460916:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789302423.460925:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302423.460930:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302423.460931:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789302423.460934:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302423.460938:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302423.460939:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789302423.460943:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302423.460953:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000637b4630) 00000020:00000080:1.0:1789302423.460967:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789302423.460971:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789302423.460973:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789302423.460976:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789302423.460983:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789302423.461058:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000445fb0f7 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789302423.461073:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000b065ce7) 00000020:00000080:1.0:1789302423.461082:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789302423.461137:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789302423.461144:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f11288 00000020:00000080:1.0:1789302423.464342:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789302423.464358:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789302423.464370:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x20be524657f1128f 00080000:01000000:1.0:1789302423.464378:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789302423.464382:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f11296 00080000:10000000:1.0:1789302423.469345:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789302423.469789:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789302423.484042:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789302423.578660:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789302423.579111:0:5868:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789302423.584058:0:5868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789302423.585004:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:3.0:1789302423.629772:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789302423.639271:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f16242b8) 00000020:00000080:0.0:1789302423.639328:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789302423.639466:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789302423.639474:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f112a4 00000020:00000080:1.0:1789302423.640210:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789302423.642180:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302423.682128:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302423.724826:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789302423.765463:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789302423.820595:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789302423.868084:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1789302423.908125:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x20be524657f112ab 00000020:00000080:0.0:1789302423.908939:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789302423.908955:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302423.908963:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302423.908966:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789302423.908971:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302423.908977:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302423.908978:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302423.908981:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302423.908983:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789302423.908987:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302423.908989:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302423.908997:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789302423.909001:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302423.909007:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302423.909008:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789302423.909013:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789302423.909064:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789302423.909137:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fef07fd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:5868:1876219505149184:0@lo:502: 00000100:00100000:0.0:1789302423.909269:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.909421:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e508f279 going to sleep for 11 seconds 00000100:00100000:1.0:1789302423.909777:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505149184 00000100:00100000:1.0:1789302423.909788:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505149184 00000100:00100000:0.0:1789302423.909942:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789302423.909954:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090c4f534 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+9:5868:x1876219505149184:12345-0@lo:502: 00000100:00100000:0.0:1789302423.910910:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090c4f534 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+9:5868:x1876219505149184:12345-0@lo:502: Request processed in 888us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302423.910924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789302423.911024:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fef07fd9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:5868:1876219505149184:0@lo:502: 00000020:01000000:2.0:1789302423.911063:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302423.911069:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302423.911072:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789302423.911077:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789302423.911711:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789302423.911741:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789302423.911804:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000a7005385/0x20be524657f1125e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302423.911818:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000a7005385/0x20be524657f1125e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302423.911950:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6905909800 from 1 10000000:01000000:0.0:1789302423.911955:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789302423.912000:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.912009:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.912020:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.912043:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149312:0@lo:101: 00000100:00100000:0.0:1789302423.912103:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.912184:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc4edef going to sleep for 11 seconds 00000100:00100000:2.0:1789302423.912483:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505149312 00000100:00100000:2.0:1789302423.912492:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505149312 00000100:00100000:2.0:1789302423.912585:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789302423.912594:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b97cee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+9:5825:x1876219505149312:12345-0@lo:101: 00010000:00010000:2.0:1789302423.912610:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302423.912628:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f112b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.912656:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f112b2 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.912688:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f112b2 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.912697:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc7f1aca, rc 0) 00000100:00100000:2.0:1789302423.912752:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b97cee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+10:5825:x1876219505149312:12345-0@lo:101: Request processed in 159us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302423.912759:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302423.912839:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149312:0@lo:101: 00010000:00010000:0.0:1789302423.912873:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.912882:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.913519:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149440:0@lo:256: 00000100:00100000:0.0:1789302423.913568:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.914203:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc4edef going to sleep for 11 seconds 00000100:00100000:1.0:1789302423.914457:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505149440 00000100:00100000:1.0:1789302423.914466:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505149440 00000100:00100000:1.0:1789302423.914515:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302423.914524:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c192695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+10:5825:x1876219505149440:12345-0@lo:256: 20000000:01000000:1.0:1789302423.914550:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789302423.914558:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789302423.914649:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c192695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+10:5825:x1876219505149440:12345-0@lo:256: Request processed in 125us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302423.914656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302423.914808:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149440:0@lo:256: 10000000:01000000:0.0:1789302423.915690:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789302423.915717:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.915729:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302423.915739:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6905909800 from 1 10000000:01000000:0.0:1789302423.915743:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302423.915784:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.915793:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.915802:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.915822:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149568:0@lo:101: 00000100:00100000:0.0:1789302423.915893:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.915925:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc4edef going to sleep for 11 seconds 00000100:00100000:1.0:1789302423.916058:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505149568 00000100:00100000:1.0:1789302423.916066:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505149568 00000100:00100000:1.0:1789302423.916096:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302423.916101:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f1ce4bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+10:5825:x1876219505149568:12345-0@lo:101: 00010000:00010000:1.0:1789302423.916113:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302423.916126:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f112c0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302423.916160:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f112c0 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302423.916170:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f112c0 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302423.916180:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009f58736, rc 0) 00000100:00100000:1.0:1789302423.916395:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f1ce4bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+11:5825:x1876219505149568:12345-0@lo:101: Request processed in 293us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302423.916464:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302423.916637:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149568:0@lo:101: 00010000:00010000:0.0:1789302423.916650:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302423.916660:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302423.916712:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149696:0@lo:501: 00000100:00100000:0.0:1789302423.916736:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.916761:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc4edef going to sleep for 11 seconds 00000100:00100000:1.0:1789302423.916815:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505149696 00000100:00100000:1.0:1789302423.916820:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505149696 00000100:00100000:1.0:1789302423.916931:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302423.916939:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008cf78aea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+11:5825:x1876219505149696:12345-0@lo:501: 00000100:00100000:1.0:1789302423.917834:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008cf78aea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+11:5825:x1876219505149696:12345-0@lo:501: Request processed in 894us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302423.917853:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302423.917949:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149696:0@lo:501: 00000100:00100000:0.0:1789302423.917989:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149824:0@lo:503: 00000100:00100000:0.0:1789302423.918033:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302423.918510:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505149824 00000100:00100000:3.0:1789302423.918517:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505149824 00000100:00100000:3.0:1789302423.918552:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789302423.918558:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005cdf3ff6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:5825:x1876219505149824:12345-0@lo:503: 00000040:00080000:3.0:1789302423.918619:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789302423.918660:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005cdf3ff6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:5825:x1876219505149824:12345-0@lo:503: Request processed in 103us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302423.918667:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302423.918758:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc4edef going to sleep for 11 seconds 00000100:00100000:0.0:1789302423.918772:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149824:0@lo:503: 00000040:00080000:0.0:1789302423.920609:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789302423.921008:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789302423.921032:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789302423.921058:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.921073:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302423.921134:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789302423.921137:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6905909800 10000000:01000000:3.0:1789302423.921156:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6905909800 10000000:01000000:3.0:1789302423.921160:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789302423.921168:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6905909800 from 1 10000000:01000000:3.0:1789302423.921171:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789302423.921258:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 00000000cd8962d4/0x20be524657f112ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.921268:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 00000000cd8962d4/0x20be524657f112ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.921278:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 00000000cd8962d4/0x20be524657f112ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302423.921448:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149952:0@lo:101: 00000100:00100000:3.0:1789302423.921531:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302423.921580:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b90e8d7 going to sleep for 11 seconds 00000100:00100000:3.0:1789302423.921610:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505149952 00000100:00100000:3.0:1789302423.921619:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505149952 00000100:00100000:3.0:1789302423.921662:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302423.921671:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000750ea88a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:5825:x1876219505149952:12345-0@lo:101: 00010000:00010000:3.0:1789302423.921688:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302423.921703:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4bf8146/0x20be524657f112d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f112ce expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.921730:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4bf8146/0x20be524657f112d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f112ce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.921743:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4bf8146/0x20be524657f112d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f112ce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.921752:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4bf8146, rc 0) 00000100:00100000:3.0:1789302423.921977:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000750ea88a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:5825:x1876219505149952:12345-0@lo:101: Request processed in 306us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302423.921985:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302423.922044:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505149952:0@lo:101: 00010000:00010000:3.0:1789302423.922062:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 00000000cd8962d4/0x20be524657f112ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302423.922071:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 00000000cd8962d4/0x20be524657f112ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302423.922130:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505150080:0@lo:501: 00000100:00100000:3.0:1789302423.922154:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302423.922167:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b90e8d7 going to sleep for 11 seconds 00000100:00100000:3.0:1789302423.922180:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505150080 00000100:00100000:3.0:1789302423.922184:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505150080 00000100:00100000:3.0:1789302423.922200:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302423.922206:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000404314e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:5825:x1876219505150080:12345-0@lo:501: 00000100:00100000:3.0:1789302423.922764:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000404314e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:5825:x1876219505150080:12345-0@lo:501: Request processed in 556us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302423.922772:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302423.922809:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505150080:0@lo:501: 00000100:00100000:3.0:1789302423.922839:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505150208:0@lo:503: 00000100:00100000:3.0:1789302423.923039:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302423.923099:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b90e8d7 going to sleep for 11 seconds 00000100:00100000:2.0:1789302423.923179:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505150208 00000100:00100000:2.0:1789302423.923185:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505150208 00000100:00100000:1.0:1789302423.923517:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789302423.923530:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e133cb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5825:x1876219505150208:12345-0@lo:503: 00000100:00100000:1.0:1789302423.923944:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e133cb1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5825:x1876219505150208:12345-0@lo:503: Request processed in 417us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302423.923952:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302423.924170:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505150208:0@lo:503: 00000100:00100000:1.0:1789302423.925930:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000046174a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:5873:1876219505150336:0@lo:502: 00000100:00100000:1.0:1789302423.926034:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302423.926081:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7e14bb7 going to sleep for 11 seconds 00000100:00100000:2.0:1789302423.926132:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505150336 00000100:00100000:2.0:1789302423.926142:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505150336 00000100:00100000:2.0:1789302423.926190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302423.926208:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f28dda88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5873:x1876219505150336:12345-0@lo:502: 00000100:00100000:2.0:1789302423.926988:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f28dda88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5873:x1876219505150336:12345-0@lo:502: Request processed in 787us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302423.926997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302423.927147:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000046174a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:5873:1876219505150336:0@lo:502: 00000020:01000004:1.0:1789302423.927257:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789302423.927538:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000eea35529) 00000020:00000080:1.0:1789302423.927565:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789302423.927674:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000445fb0f7 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789302423.927678:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000445fb0f7 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789302423.927680:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000445fb0f7 4 00010000:00080000:1.0:1789302423.927715:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002ca1913d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:1.0:1789302423.931371:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789302423.931680:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789302423.931730:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789302423.931747:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x20be524657f112e3 00000100:00080000:1.0:1789302423.931761:0:5873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302423.931774:0:5873:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002ca1913d using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789302423.931820:0:5873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000046174a1 x1876219505150464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302423.932271:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000046174a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505150464:0@lo:38: 00000100:00100000:2.0:1789302423.932482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789302423.932589:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789302423.933436:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505150464 00000100:00100000:1.0:1789302423.933448:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505150464 00000100:00100000:1.0:1789302423.933497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302423.933506:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009fb76b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505150464:12345-0@lo:38: 00000100:00100000:3.0:1789302423.933806:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:5873:1876219505150592:0@lo:502: 00000100:00100000:3.0:1789302423.933997:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302423.934032:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505150592 00000100:00100000:3.0:1789302423.934037:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505150592 00000100:00100000:3.0:1789302423.934074:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302423.934082:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007048dffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:5873:x1876219505150592:12345-0@lo:502: 00000100:00100000:3.0:1789302423.934518:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007048dffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:5873:x1876219505150592:12345-0@lo:502: Request processed in 434us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302423.934527:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302423.934656:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be3d172a going to sleep for 11 seconds 00000100:00100000:3.0:1789302423.934684:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:5873:1876219505150592:0@lo:502: 00000040:00080000:3.0:1789302423.934719:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:1.0:1789302423.935079:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009fb76b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505150464:12345-0@lo:38: Request processed in 1572us (2597us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789302423.935090:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302423.935170:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302423.935179:0:3302:0:(import.c:65:import_set_state_nolock()) 000000002ca1913d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302423.935184:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789302423.935187:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000046174a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505150464:0@lo:38: 00000020:01000000:2.0:1789302423.937987:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789302423.938031:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302423.938056:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 00000000cd8962d4/0x20be524657f112ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302423.938086:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 00000000cd8962d4/0x20be524657f112ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789302423.938147:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789302423.938150:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302423.938152:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302423.938153:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302423.938155:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302423.938156:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302423.938157:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302423.938159:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302423.938160:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302423.938161:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302423.938163:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302423.938164:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302423.938168:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789302423.938171:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302423.938173:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302423.938174:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302423.938175:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302423.938176:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302423.938177:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302423.938178:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302423.938179:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302423.938180:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302423.938181:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302423.938182:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302423.938182:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302423.938464:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789302423.938489:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049360116 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505150720:0@lo:253: 00000100:00100000:2.0:1789302423.938566:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302423.938618:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505150720 00000100:00100000:0.0:1789302423.938636:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505150720 00000100:00100000:2.0:1789302423.938661:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000324b7c10 going to sleep for 11 seconds 00000100:00100000:0.0:1789302423.940495:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302423.940517:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000486caa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:5825:x1876219505150720:12345-0@lo:253: 20000000:01000000:0.0:1789302423.940559:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789302423.940574:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789302424.003380:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789302424.003462:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789302424.003777:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789302424.003783:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789302424.003813:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302424.003854:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f112b2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302424.003862:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302424.004083:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f112b2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302424.004101:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f112b2 expref: 12 pid: 5838 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302424.004118:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876219505150848:0@lo:104: 00000100:00100000:1.0:1789302424.005367:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302424.005458:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e508f279 going to sleep for 11 seconds 00000100:00100000:0.0:1789302424.005635:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505150848 00000100:00100000:0.0:1789302424.005655:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505150848 00000100:00100000:0.0:1789302424.005725:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302424.005734:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd27124b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:5861:x1876219505150848:12345-0@lo:104: 00010000:00010000:0.0:1789302424.005752:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302424.005910:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302424.005917:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd27124b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:5861:x1876219505150848:12345-0@lo:104: Request processed in 185us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302424.005925:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789302424.005933:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302424.005940:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.005948:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000062c31a13 already unused, calling callback (000000000b89ba3b) 10000000:00010000:3.0:1789302424.005952:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.005961:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302424.005968:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302424.005973:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302424.006017:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006038:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302424.006067:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006074:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 0000000062c31a13/0x20be524657f112b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112b9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006093:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302424.006095:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302424.006097:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302424.006234:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505150976:0@lo:103: 00000100:00100000:0.0:1789302424.006312:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302424.006459:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e1ca2454 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876219505150848:0@lo:104: 00010000:00010000:1.0:1789302424.006485:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302424.006718:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505150976 00000100:00100000:3.0:1789302424.006724:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505150976 00010000:00010000:3.0:1789302424.006757:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f112b2 expref: 13 pid: 5838 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302424.006785:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302424.006792:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aea87bf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+13:3304:x1876219505150976:12345-0@lo:103: 00010000:00010000:3.0:1789302424.006806:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302424.006812:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f112b2 expref: 13 pid: 5838 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006823:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f112b2 expref: 13 pid: 5838 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006837:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc7f1aca/0x20be524657f112b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f112b2 expref: 13 pid: 5838 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006853:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006870:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789302424.006889:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003106023s 00010000:00010000:3.0:1789302424.006893:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006900:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006907:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.006912:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.007005:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000053dd0b7e already unused, calling callback (00000000109891ae) 00010000:00010000:3.0:1789302424.007009:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.007018:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.007032:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.007043:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302424.007088:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aea87bf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+12:3304:x1876219505150976:12345-0@lo:103: Request processed in 297us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302424.007095:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789302424.007122:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.007129:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302424.007134:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000053dd0b7e/0x20be524657f112ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302424.007896:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c204fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505150976:0@lo:103: 00000100:00100000:3.0:1789302424.031978:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000486caa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:5825:x1876219505150720:12345-0@lo:253: Request processed in 91403us (93342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302424.031999:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302424.032131:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049360116 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:5825:1876219505150720:0@lo:253: 10000000:01000000:0.0:1789302424.032151:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789302424.032155:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789302424.032157:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302424.032159:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302424.032160:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302424.032161:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302424.032162:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302424.032164:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302424.032165:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302424.032166:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302424.032168:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302424.032170:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302424.032171:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789302424.032191:0:5825:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789302424.047186:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789302424.047855:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789302424.048894:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789302424.049109:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789302424.049385:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789302424.049688:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789302424.053356:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789302424.054239:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789302424.055165:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302424.055722:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789302424.057158:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302424.057789:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789302424.208093:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789302424.296994:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789302424.297030:0:5878:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789302424.297041:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789302424.297399:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789302424.309382:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789302424.310527:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789302424.311503:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789302424.311517:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789302424.311712:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302424.314844:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789302424.315757:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789302424.316686:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789302424.317558:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789302424.317773:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789302424.322822:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789302424.322979:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789302424.323131:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789302424.331154:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789302424.331414:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789302424.332827:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789302424.333073:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789302424.333241:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789302424.333424:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789302424.333678:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789302424.333886:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789302424.334034:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789302424.335596:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789302424.335757:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789302424.335924:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789302424.336102:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789302424.337013:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789302424.337846:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789302424.338022:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789302424.338209:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789302424.338387:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789302424.338571:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789302424.338727:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789302424.338880:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789302424.339044:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789302424.339196:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789302424.339369:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789302424.339504:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789302424.339670:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789302424.339800:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789302424.339921:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789302424.340089:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789302424.340269:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789302424.372827:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302424.447556:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789302424.447635:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789302424.447639:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1789302424.448659:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789302424.448684:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae4641c87988 00100000:10000000:2.0:1789302424.448692:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789302424.449951:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789302424.449966:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789302424.449980:0:5825:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789302424.450009:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789302424.659948:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302425.679940:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302426.701895:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302427.733791:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302428.753496:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789302429.072031:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789302429.072039:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6905909800 from 3 10000000:01000000:0.0:1789302429.072044:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:3.0:1789302429.072199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789302429.072204:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302429.072207:0:36:0:(import.c:65:import_set_state_nolock()) 000000002ca1913d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302429.072237:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002ca1913d using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789302429.072259:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f4c53c3 x1876219505151232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302429.072418:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003fd8308 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505151104:0@lo:400: 00010000:00010000:0.0:1789302429.072600:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 000000002132f688/0x20be524657f112f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302429.072611:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 000000002132f688/0x20be524657f112f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302429.072621:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 000000002132f688/0x20be524657f112f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302429.072634:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8a7883d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505151360:0@lo:101: 00000100:00100000:0.0:1789302429.072672:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302429.072713:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3bfe006 going to sleep for 11 seconds 00000100:00100000:3.0:1789302429.074090:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302429.074208:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f4c53c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505151232:0@lo:38: 00000100:00100000:3.0:1789302429.074268:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302429.074331:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505151360 00000100:00100000:3.0:1789302429.074341:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505151360 00000100:00100000:3.0:1789302429.074379:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505151104 00000100:00100000:3.0:1789302429.074382:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505151104 00000100:00100000:3.0:1789302429.074396:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789302429.074404:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000454eb1bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505151360:12345-0@lo:101: 00010000:00010000:3.0:1789302429.074417:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302429.074433:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097ec5c44/0x20be524657f112f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f112f1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302429.074456:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097ec5c44/0x20be524657f112f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f112f1 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302429.074479:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097ec5c44/0x20be524657f112f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f112f1 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302429.074487:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097ec5c44, rc 0) 00000100:00100000:3.0:1789302429.074523:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000454eb1bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505151360:12345-0@lo:101: Request processed in 120us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302429.074529:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789302429.074555:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789302429.074561:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000001cfe09f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505151104:12345-0@lo:400: 00000100:00100000:3.0:1789302429.074589:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000001cfe09f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505151104:12345-0@lo:400: Request processed in 30us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302429.074596:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789302429.074693:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505151232 00000100:00100000:0.0:1789302429.074697:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505151232 00000100:00100000:0.0:1789302429.074726:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302429.074730:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d82d3fe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1876219505151232:12345-0@lo:38: 00010000:00080000:0.0:1789302429.074759:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:0.0:1789302429.074794:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x20be524657f112ff 00000004:00100000:0.0:1789302429.074835:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789302429.074947:0:5847:0:(import.c:65:import_set_state_nolock()) 00000000db71f4d0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302429.075000:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d82d3fe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876219505151232:12345-0@lo:38: Request processed in 269us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302429.075007:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302429.075042:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8a7883d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505151360:0@lo:101: 00010000:00010000:0.0:1789302429.075061:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 000000002132f688/0x20be524657f112f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302429.075069:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 000000002132f688/0x20be524657f112f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302429.075118:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8a7883d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505151488:0@lo:256: 00000100:00100000:0.0:1789302429.075147:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302429.075166:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3bfe006 going to sleep for 11 seconds 00000100:00100000:0.0:1789302429.075177:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505151488 00000100:00100000:0.0:1789302429.075180:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505151488 00000100:00100000:0.0:1789302429.075201:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302429.075206:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000673f8b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505151488:12345-0@lo:256: 20000000:01000000:0.0:1789302429.075232:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789302429.075247:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789302429.075250:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00010000:00080000:1.0:1789302429.075276:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000f4c53c3 x1876219505151232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789302429.075306:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789302429.075314:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789302429.075320:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789302429.075322:0:3302:0:(import.c:65:import_set_state_nolock()) 000000002ca1913d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789302429.075327:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f4c53c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505151232:0@lo:38: 00000100:00100000:0.0:1789302429.075341:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000673f8b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505151488:12345-0@lo:256: Request processed in 135us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302429.075348:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302429.075382:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8a7883d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505151488:0@lo:256: 10000000:01000000:0.0:1789302429.075416:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789302429.075422:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: 000000002132f688/0x20be524657f112f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302429.075429:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: 000000002132f688/0x20be524657f112f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302429.075711:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003fd8308 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505151104:0@lo:400: 00000001:02000400:2.0:1789302429.363648:0:6122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789302429.774062:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302430.800765:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302431.821611:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302432.845688:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302433.869838:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302434.189599:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302434.189683:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302434.189708:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd84cbf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505151744:0@lo:400: 00000100:00100000:3.0:1789302434.189800:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302434.189903:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505151744 00000100:00100000:3.0:1789302434.189913:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505151744 00000100:00100000:3.0:1789302434.189970:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302434.189980:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d2cd3a9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505151744:12345-0@lo:400: 00000100:00100000:2.0:1789302434.189981:0:5845:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789302434.189990:0:5845:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789302434.190047:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d2cd3a9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505151744:12345-0@lo:400: Request processed in 69us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302434.190055:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789302434.190099:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bd84cbf3 x1876219505151744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302434.190115:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd84cbf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505151744:0@lo:400: 00000100:00100000:2.0:1789302434.192141:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003fd8308 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505151616:0@lo:400: 00000100:00100000:2.0:1789302434.192575:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302434.192727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505151616 00000100:00100000:1.0:1789302434.192739:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505151616 00000100:00100000:1.0:1789302434.192845:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302434.192855:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc5a8cdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505151616:12345-0@lo:400: 00000100:00100000:1.0:1789302434.192941:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc5a8cdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505151616:12345-0@lo:400: Request processed in 88us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302434.192955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302434.192999:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003fd8308 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505151616:0@lo:400: 00010000:00010000:0.0:1789302434.897613:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789302434.951785:0:6325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf67bbc10 20000000:00000080:1.0:1789302434.951812:0:6325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a693bc8a800 uarg=0000000000000000 20000000:01000000:1.0:1789302434.951869:0:6325:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789302434.951878:0:6325:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789302434.951885:0:6325:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789302434.952142:0:6325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789302434.952156:0:6325:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789302434.975696:0:6325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302434.977124:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789302434.977229:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789302434.977282:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789302434.977344:0:6325:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789302434.977369:0:6325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.977392:0:6325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f112c0 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.977401:0:6325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.977451:0:6325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f112c0 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.977470:0:6325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f112c0 expref: 11 pid: 5840 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302434.977505:0:6325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8a7883d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6325:1876219505151872:0@lo:104: 00000100:00100000:0.0:1789302434.977589:0:6325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302434.979022:0:6325:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b36c671 going to sleep for 11 seconds 00000100:00100000:1.0:1789302434.980547:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505151872 00000100:00100000:1.0:1789302434.980567:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505151872 00000100:00100000:0.0:1789302434.980940:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302434.980951:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000040ac5a93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:6325:x1876219505151872:12345-0@lo:104: 00010000:00010000:0.0:1789302434.980975:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.981103:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302434.981109:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000040ac5a93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:6325:x1876219505151872:12345-0@lo:104: Request processed in 160us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302434.981116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302434.981277:0:6325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8a7883d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6325:1876219505151872:0@lo:104: 00010000:00010000:2.0:1789302434.981339:0:6325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302434.982498:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302434.982508:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302434.982518:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a5c78fcc already unused, calling callback (000000000b89ba3b) 10000000:00010000:3.0:1789302434.982523:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302434.982533:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302434.982540:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302434.982565:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302434.982621:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302434.982630:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789302434.982696:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd84cbf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505152000:0@lo:103: 00000100:00100000:2.0:1789302434.982764:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302434.982917:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505152000 00000100:00100000:0.0:1789302434.982926:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505152000 00010000:00010000:0.0:1789302434.982958:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f112c0 expref: 12 pid: 5840 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302434.982993:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302434.983002:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c18c13f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+12:3304:x1876219505152000:12345-0@lo:103: 00010000:00010000:0.0:1789302434.983017:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302434.983023:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f112c0 expref: 12 pid: 5840 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983034:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f112c0 expref: 12 pid: 5840 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983051:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000009f58736/0x20be524657f112c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f112c0 expref: 12 pid: 5840 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983086:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983095:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983112:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983120:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983127:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983133:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983139:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000062c31a13 already unused, calling callback (00000000109891ae) 00010000:00010000:0.0:1789302434.983143:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983150:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983171:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302434.983192:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302434.983259:0:6325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302434.983271:0:6325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302434.983278:0:6325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000062c31a13/0x20be524657f11306 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302434.983320:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302434.983330:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: 00000000a5c78fcc/0x20be524657f112c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302434.983351:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302434.983353:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302434.983356:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302434.985461:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c18c13f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+11:3304:x1876219505152000:12345-0@lo:103: Request processed in 2449us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302434.985493:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302434.987425:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd84cbf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505152000:0@lo:103: 00010000:00010000:0.0:1789302435.920414:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302436.941974:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789302437.840151:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302437.840171:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6905909800 from 1 10000000:01000000:1.0:1789302437.840176:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302437.840238:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: 0000000009f58736/0x20be524657f1130d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302437.840252:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: 0000000009f58736/0x20be524657f1130d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302437.840264:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: 0000000009f58736/0x20be524657f1130d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302437.840307:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4a49f94 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505152128:0@lo:101: 00000100:00100000:1.0:1789302437.840381:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302437.840428:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000531c9944 going to sleep for 11 seconds 00000100:00100000:0.0:1789302437.843447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505152128 00000100:00100000:0.0:1789302437.843461:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505152128 00000100:00100000:0.0:1789302437.843525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302437.843535:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036dc9830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:5842:x1876219505152128:12345-0@lo:101: 00010000:00010000:0.0:1789302437.843552:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302437.843572:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ffc7427/0x20be524657f11314 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1130d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302437.843601:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ffc7427/0x20be524657f11314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1130d expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302437.843612:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ffc7427/0x20be524657f11314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1130d expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302437.843620:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ffc7427, rc 0) 00000100:00100000:0.0:1789302437.843710:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036dc9830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505152128:12345-0@lo:101: Request processed in 175us (3328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302437.843718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302437.843789:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4a49f94 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505152128:0@lo:101: 00010000:00010000:0.0:1789302437.843806:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: 0000000009f58736/0x20be524657f1130d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302437.843815:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: 0000000009f58736/0x20be524657f1130d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302437.843894:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb640b46 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505152256:0@lo:501: 00000100:00100000:0.0:1789302437.843936:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302437.844001:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000324b7c10 going to sleep for 11 seconds 00000100:00100000:0.0:1789302437.844014:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505152256 00000100:00100000:0.0:1789302437.844018:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505152256 00000100:00100000:0.0:1789302437.844044:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302437.844052:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004424784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505152256:12345-0@lo:501: 00000100:00100000:0.0:1789302437.844344:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004424784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505152256:12345-0@lo:501: Request processed in 289us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302437.844351:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302437.844413:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb640b46 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505152256:0@lo:501: 00000100:00100000:0.0:1789302437.844450:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb640b46 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505152384:0@lo:503: 00000100:00100000:0.0:1789302437.844497:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302437.844524:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023529345 going to sleep for 11 seconds 00000100:00100000:0.0:1789302437.844549:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505152384 00000100:00100000:0.0:1789302437.844554:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505152384 00000100:00100000:0.0:1789302437.844592:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302437.844603:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000015aaffa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505152384:12345-0@lo:503: 00000100:00100000:0.0:1789302437.844772:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000015aaffa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505152384:12345-0@lo:503: Request processed in 174us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302437.844779:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789302437.844812:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb640b46 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505152384:0@lo:503: 00000100:00100000:0.0:1789302437.844951:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb640b46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6500:1876219505152512:0@lo:502: 00000100:00100000:0.0:1789302437.844987:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302437.845008:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505152512 00000100:00100000:0.0:1789302437.845011:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505152512 00000100:00100000:0.0:1789302437.845028:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789302437.845032:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f466a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6500:x1876219505152512:12345-0@lo:502: 00000100:00100000:0.0:1789302437.845127:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f466a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6500:x1876219505152512:12345-0@lo:502: Request processed in 94us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302437.845133:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789302437.845175:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023529345 going to sleep for 11 seconds 00000100:00100000:0.0:1789302437.845186:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb640b46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6500:1876219505152512:0@lo:502: 00000020:01000000:0.0:1789302437.845206:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302437.845216:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302437.845218:0:6500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789302437.845225:0:6500:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6905909800 00000020:00000080:0.0:1789302437.845227:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789302437.845259:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6500:1876219505152640:0@lo:502: 00000100:00100000:0.0:1789302437.845315:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302437.845333:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505152640 00000100:00100000:0.0:1789302437.845336:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505152640 00000100:00100000:0.0:1789302437.845355:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789302437.845360:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:6500:x1876219505152640:12345-0@lo:502: 00000100:00100000:0.0:1789302437.845448:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:6500:x1876219505152640:12345-0@lo:502: Request processed in 87us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302437.845454:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789302437.845481:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690cd1eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302437.845492:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6500:1876219505152640:0@lo:502: 00000020:01000000:0.0:1789302437.845511:0:6500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302437.845514:0:6500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302437.845516:0:6500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789302437.845523:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789302437.845567:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789302437.845582:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302437.845591:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302437.845601:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302437.967141:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302438.990246:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302439.309753:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505152768:0@lo:400: 00000100:00100000:1.0:1789302439.309869:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302439.309953:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302439.309961:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505152896:0@lo:400: 00000100:00100000:1.0:1789302439.309997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302439.312421:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505152768 00000100:00100000:0.0:1789302439.312440:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505152768 00000100:00100000:0.0:1789302439.312536:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789302439.312549:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505152768:12345-0@lo:400: 00000100:00100000:0.0:1789302439.312686:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505152768:12345-0@lo:400: Request processed in 139us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302439.312695:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789302439.312747:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505152896 00000100:00100000:0.0:1789302439.312751:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505152896 00000100:00100000:0.0:1789302439.312795:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302439.312802:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505152896:12345-0@lo:400: 00000100:00100000:0.0:1789302439.312840:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505152896:12345-0@lo:400: Request processed in 38us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302439.312846:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789302439.312930:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6903e37100 x1876219505152896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302439.312949:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505152896:0@lo:400: 00000100:00100000:0.0:1789302439.312963:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505152768:0@lo:400: 00010000:00010000:0.0:1789302440.015247:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302441.037593:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302442.062594:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789302442.118420:0:6694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789302442.118426:0:6694:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789302442.118570:0:6694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a6902e2c800 00000020:01000004:1.0:1789302442.118592:0:6694:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789302442.118609:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789302442.118628:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a693ba64d40) 00000020:00000080:1.0:1789302442.118648:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789302442.150018:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789302442.150787:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789302442.204152:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789302442.217664:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789302442.217704:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789302442.217768:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789302442.217801:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789302442.221115:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789302442.221152:0:6694:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789302442.221589:0:6694:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x20be524657f11322 00000020:01000004:3.0:1789302442.221604:0:6694:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789302442.221657:0:6694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789302442.221661:0:6694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789302442.222786:0:6694:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789302442.223055:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789302442.223082:0:6694:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a690a590000) 00000020:00000080:3.0:1789302442.223106:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789302442.224957:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302442.225557:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789302442.225567:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789302442.226593:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789302442.226606:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789302442.237085:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789302442.238097:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789302442.243790:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302442.245456:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789302442.245466:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789302442.246517:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789302442.246529:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789302442.308545:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302442.309253:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789302442.309263:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789302442.315514:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789302442.315538:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789302442.319320:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789302442.319343:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789302442.325155:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302442.325536:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789302442.325544:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789302442.326979:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789302442.326993:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789302442.392754:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302442.392956:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789302442.392963:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789302442.394076:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789302442.394085:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789302442.394568:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789302442.394592:0:6694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789302442.394598:0:6694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789302442.412158:0:6694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789302442.412199:0:6694:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.142@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789302442.412205:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789302442.412207:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789302442.412208:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302442.412209:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302442.412211:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302442.412212:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302442.412214:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789302442.412215:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302442.412217:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302442.412219:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302442.412220:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302442.412224:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789302442.412227:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789302442.412228:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789302442.412235:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302442.412236:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302442.412237:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302442.412238:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302442.412239:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789302442.412240:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302442.412241:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302442.412242:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302442.412242:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302442.412271:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789302442.412316:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505153024:0@lo:253: 00000100:00100000:0.0:1789302442.412397:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302442.412535:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903752f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302442.412625:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505153024 00000100:00100000:2.0:1789302442.412634:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505153024 00000100:00100000:2.0:1789302442.412726:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789302442.412737:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505153024:12345-0@lo:253: 20000000:01000000:2.0:1789302442.412794:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789302442.412799:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789302442.412804:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789302442.412808:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789302442.413786:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302442.419331:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789302442.419375:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789302442.419482:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789302442.419491:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789302442.419526:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789302442.419584:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789302442.424376:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789302442.424411:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:3.0:1789302442.424414:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789302442.424448:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789302442.424457:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789302442.424512:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789302442.424521:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:3.0:1789302442.424552:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789302442.424562:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789302442.424593:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789302442.424644:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789302442.425441:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789302442.425460:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:3.0:1789302442.425462:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:3.0:1789302442.425497:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789302442.425515:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789302442.425561:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789302442.425570:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:3.0:1789302442.425627:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789302442.425637:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789302442.425672:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789302442.425712:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789302442.425729:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789302442.425732:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789302442.425736:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789302442.425747:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789302442.425750:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789302442.425781:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789302442.425783:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789302442.429754:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789302442.429844:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789302442.429901:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789302442.431198:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789302442.431247:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789302442.431366:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789302442.431383:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789302442.431386:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789302442.432648:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789302442.432715:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789302442.432767:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789302442.441708:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789302442.441766:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789302442.441804:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789302442.441817:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789302442.441820:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789302442.442630:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789302442.444430:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789302442.444480:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789302442.444576:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789302442.444595:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789302442.444597:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789302442.444607:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789302442.444625:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.444643:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba7400/0x20be524657f11249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11242 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.444651:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abfa00/0x20be524657f11265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1125e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.444657:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba6000/0x20be524657f112d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f112ce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.444675:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.444717:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba6000/0x20be524657f112d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f112ce expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.444733:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba6000/0x20be524657f112d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f112ce expref: 12 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302442.444748:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505153152:0@lo:104: 00000100:00100000:0.0:1789302442.444812:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302442.444891:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abfa00/0x20be524657f11265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1125e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.444901:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6923abfa00/0x20be524657f11265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1125e expref: 12 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302442.444910:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505153280:0@lo:104: 00000100:00100000:0.0:1789302442.444934:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302442.444969:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba7400/0x20be524657f11249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f11242 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.444977:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba7400/0x20be524657f11249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f11242 expref: 12 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302442.445001:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505153408:0@lo:104: 00000100:00100000:2.0:1789302442.445024:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505153152 00000100:00100000:0.0:1789302442.445037:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302442.445050:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69037523c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302442.445057:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505153152 00000100:00100000:2.0:1789302442.445134:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505153280 00000100:00100000:2.0:1789302442.445139:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505153280 00000100:00100000:1.0:1789302442.445154:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505153408 00000100:00100000:1.0:1789302442.445166:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505153408 00000100:00100000:2.0:1789302442.445172:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302442.445187:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+5:5839:x1876219505153152:12345-0@lo:104: 00010000:00010000:2.0:1789302442.445219:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f112ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.445369:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302442.445376:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+5:5839:x1876219505153152:12345-0@lo:104: Request processed in 193us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.445384:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302442.445410:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302442.445416:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:5839:x1876219505153280:12345-0@lo:104: 00010000:00010000:2.0:1789302442.445424:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f1125e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.445486:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789302442.445508:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:5839:x1876219505153280:12345-0@lo:104: Request processed in 92us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.445516:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302442.445541:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302442.445550:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:5839:x1876219505153408:12345-0@lo:104: 00010000:00010000:2.0:1789302442.445558:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f11242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302442.445589:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505153152:0@lo:104: 00010000:00010000:2.0:1789302442.445595:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789302442.445608:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:5839:x1876219505153408:12345-0@lo:104: Request processed in 58us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.445617:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302442.445625:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505153280:0@lo:104: 00000100:00100000:0.0:1789302442.445645:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505153408:0@lo:104: 00010000:00010000:0.0:1789302442.445671:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.445738:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789302442.445746:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f112ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.445755:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7800 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302442.445759:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f112ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.445769:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f112ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302442.445776:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f112ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302442.445783:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302442.445824:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f112ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.445831:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302442.445859:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f112ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.445873:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f112ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112d5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.445890:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302442.445894:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f1125e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.445901:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302442.445904:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f1125e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302442.445909:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505153536:0@lo:103: 00010000:00010000:1.0:1789302442.445926:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f1125e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302442.445937:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f1125e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302442.445942:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302442.445965:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f1125e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302442.445975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302442.445999:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302442.446012:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f1125e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.446020:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f1125e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11265 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302442.446031:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789302442.446035:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789302442.446044:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505153664:0@lo:103: 00010000:00010000:1.0:1789302442.446050:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f11242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.446060:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031a00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302442.446064:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f11242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.446072:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f11242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302442.446086:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789302442.446093:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f11242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302442.446102:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302442.446140:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f11242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.446148:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789302442.446154:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505153536 00000100:00100000:2.0:1789302442.446164:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505153536 00010000:00010000:1.0:1789302442.446173:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f11242 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.446182:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f11242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11249 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.446199:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302442.446200:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302442.446203:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302442.446208:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba6000/0x20be524657f112d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f112ce expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302442.446241:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505153664 00000100:00100000:1.0:1789302442.446249:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505153664 00000100:00100000:2.0:1789302442.446251:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302442.446263:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+14:3303:x1876219505153536:12345-0@lo:103: 00010000:00010000:1.0:1789302442.446276:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abfa00/0x20be524657f11265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1125e expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446283:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302442.446339:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba6000/0x20be524657f112d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f112ce expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302442.446348:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789302442.446361:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789302442.446380:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba6000/0x20be524657f112d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f112ce expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302442.446393:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505153792:0@lo:103: 00010000:00010000:2.0:1789302442.446404:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba6000/0x20be524657f112d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f112ce expref: 14 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446425:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302442.446448:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.446492:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+13:3303:x1876219505153536:12345-0@lo:103: Request processed in 228us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.446500:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302442.446524:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505153792 00000100:00100000:2.0:1789302442.446531:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505153792 00010000:00010000:2.0:1789302442.446549:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba7400/0x20be524657f11249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11242 expref: 13 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302442.446572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789302442.446577:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302442.446584:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+13:3303:x1876219505153664:12345-0@lo:103: 00010000:00010000:2.0:1789302442.446594:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302442.446600:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abfa00/0x20be524657f11265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1125e expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446610:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abfa00/0x20be524657f11265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1125e expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446624:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abfa00/0x20be524657f11265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1125e expref: 13 pid: 5839 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446636:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302442.446665:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+12:3303:x1876219505153664:12345-0@lo:103: Request processed in 87us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.446682:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302442.446700:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302442.446708:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+11:3305:x1876219505153792:12345-0@lo:103: 00010000:00010000:2.0:1789302442.446716:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302442.446721:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba7400/0x20be524657f11249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11242 expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446731:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba7400/0x20be524657f11249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f11242 expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446741:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7400/0x20be524657f11249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f11242 expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446754:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446763:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446779:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446786:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446870:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446878:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446895:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302442.446900:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446908:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446932:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.446943:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302442.446986:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+10:3305:x1876219505153792:12345-0@lo:103: Request processed in 279us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.446993:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302442.447062:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505153664:0@lo:103: 00000100:00100000:2.0:1789302442.447071:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505153536:0@lo:103: 00010000:00010000:0.0:1789302442.447132:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.447143:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.447151:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900031e00/0x20be524657f11330 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789302442.447172:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789302442.447181:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505153792:0@lo:103: 00000100:00100000:2.0:1789302442.525730:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+9:6694:x1876219505153024:12345-0@lo:253: Request processed in 112979us (113317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.525749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789302442.525916:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505153024:0@lo:253: 10000000:01000000:0.0:1789302442.525936:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789302442.525939:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789302442.525941:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789302442.525943:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302442.525944:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789302442.525946:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302442.525947:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302442.525949:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789302442.525951:0:6694:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789302442.525953:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302442.525954:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789302442.525979:0:6694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6902e2c800 from lustre-OST0000 10000000:01000000:0.0:1789302442.526011:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789302442.526015:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789302442.526024:0:6694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a690a593380 local copy 10000000:01000000:0.0:1789302442.526029:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789302442.526095:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.526108:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.526117:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302442.526151:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505153920:0@lo:101: 00000100:00100000:0.0:1789302442.526261:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302442.526354:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302442.526428:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505153920 00000100:00100000:1.0:1789302442.526438:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505153920 00000100:00100000:1.0:1789302442.526492:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789302442.526504:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+9:6694:x1876219505153920:12345-0@lo:101: 00010000:00010000:1.0:1789302442.526521:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302442.526538:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c8000/0x20be524657f1133e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11337 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.526571:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c8000/0x20be524657f1133e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11337 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.526584:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c8000/0x20be524657f1133e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11337 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.526595:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c8000, rc 0) 00000100:00100000:1.0:1789302442.526633:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+10:6694:x1876219505153920:12345-0@lo:101: Request processed in 132us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302442.526639:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789302442.526784:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505153920:0@lo:101: 00010000:00010000:0.0:1789302442.526875:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.526886:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302442.527037:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154048:0@lo:501: 00000100:00100000:0.0:1789302442.527068:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302442.527094:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302442.527174:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505154048 00000100:00100000:1.0:1789302442.527179:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505154048 00000100:00100000:1.0:1789302442.527213:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789302442.527222:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+10:6694:x1876219505154048:12345-0@lo:501: 00000100:00100000:1.0:1789302442.527494:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+10:6694:x1876219505154048:12345-0@lo:501: Request processed in 272us (424us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302442.527508:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789302442.527696:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154048:0@lo:501: 10000000:01000000:0.0:1789302442.527712:0:6694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789302442.527744:0:6694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789302442.527751:0:6694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.527760:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.527774:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.527859:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789302442.527885:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6902e2c800 10000000:01000000:0.0:1789302442.527891:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789302442.527897:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a690a593380 10000000:01000000:0.0:1789302442.527899:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789302442.527904:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a690a593380 from 1 10000000:01000000:0.0:1789302442.527907:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789302442.527929:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.527936:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302442.527947:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302442.527964:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154176:0@lo:101: 00000100:00100000:0.0:1789302442.527996:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302442.528069:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302442.528078:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.528086:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031e00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302442.528090:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.528100:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302442.528108:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302442.528113:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302442.528142:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.528148:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302442.528187:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.528196:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f11337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x20be524657f1133e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.528216:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302442.528218:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302442.528220:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302442.528230:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302442.528254:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505154304:0@lo:103: 00000100:00100000:0.0:1789302442.528274:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302442.528329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.528500:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505154176 00000100:00100000:2.0:1789302442.528508:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505154176 00000100:00100000:2.0:1789302442.528583:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302442.528593:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+10:6694:x1876219505154176:12345-0@lo:101: 00010000:00010000:2.0:1789302442.528606:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302442.528623:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abfa00/0x20be524657f1134c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11345 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.528659:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abfa00/0x20be524657f1134c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11345 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.528670:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abfa00/0x20be524657f1134c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11345 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.528680:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abfa00, rc 0) 00000100:00100000:2.0:1789302442.528732:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154176:12345-0@lo:101: Request processed in 141us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.528739:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789302442.528822:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154176:0@lo:101: 00010000:00010000:3.0:1789302442.528838:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1134c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.528847:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1134c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302442.528881:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789302442.528897:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1134c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.528904:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1134c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302442.528912:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789302442.528917:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789302442.528923:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789302442.528926:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789302442.528946:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.528953:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.528959:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302442.528974:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154432:0@lo:101: 00000100:00100000:3.0:1789302442.529025:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302442.529173:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302442.529262:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505154432 00000100:00100000:1.0:1789302442.529268:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505154432 00000100:00100000:3.0:1789302442.529368:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505154304 00000100:00100000:3.0:1789302442.529373:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505154304 00000100:00100000:3.0:1789302442.529414:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302442.529421:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505154304:12345-0@lo:103: 00010000:00010000:3.0:1789302442.529433:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302442.529456:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c8000/0x20be524657f1133e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11337 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.529472:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302442.529509:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+11:3305:x1876219505154304:12345-0@lo:103: Request processed in 88us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302442.529515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302442.529575:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789302442.529584:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+10:6694:x1876219505154432:12345-0@lo:101: 00010000:00010000:1.0:1789302442.529594:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302442.529606:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11353 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.529621:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11353 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.529629:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11353 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.529636:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9800, rc 0) 00000100:00100000:1.0:1789302442.529713:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154432:12345-0@lo:101: Request processed in 130us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302442.529719:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789302442.529761:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505154304:0@lo:103: 00000100:00100000:3.0:1789302442.529929:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154432:0@lo:101: 00010000:00010000:3.0:1789302442.529943:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.529953:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302442.530080:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154560:0@lo:501: 00000100:00100000:3.0:1789302442.530111:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302442.530246:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302442.530281:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505154560 00000100:00100000:1.0:1789302442.530401:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505154560 00000100:00100000:1.0:1789302442.530473:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789302442.530482:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154560:12345-0@lo:501: 00000100:00100000:1.0:1789302442.530753:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154560:12345-0@lo:501: Request processed in 272us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302442.530760:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789302442.530891:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154560:0@lo:501: 00000100:00100000:3.0:1789302442.530926:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154688:0@lo:503: 00000100:00100000:3.0:1789302442.530970:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302442.531053:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302442.531090:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505154688 00000100:00100000:2.0:1789302442.531096:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505154688 00000100:00100000:2.0:1789302442.531118:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302442.531134:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154688:12345-0@lo:503: 00000100:00100000:2.0:1789302442.531400:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154688:12345-0@lo:503: Request processed in 265us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.531407:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789302442.531507:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154688:0@lo:503: 00000040:00080000:3.0:1789302442.531883:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789302442.531962:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154816:0@lo:502: 00000100:00100000:3.0:1789302442.532003:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302442.532026:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302442.532088:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505154816 00000100:00100000:2.0:1789302442.532093:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505154816 00000100:00100000:2.0:1789302442.532137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789302442.532146:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154816:12345-0@lo:502: 00000100:00100000:2.0:1789302442.532422:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154816:12345-0@lo:502: Request processed in 276us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.532429:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789302442.532525:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154816:0@lo:502: 00000040:00080000:3.0:1789302442.532856:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789302442.532913:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789302442.532946:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789302442.532992:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789302442.533030:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789302442.533059:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789302442.533090:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154944:0@lo:502: 00000100:00100000:3.0:1789302442.533149:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302442.533255:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302442.533335:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505154944 00000100:00100000:2.0:1789302442.533341:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505154944 00000100:00100000:2.0:1789302442.533379:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302442.533394:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154944:12345-0@lo:502: 00000100:00100000:2.0:1789302442.533547:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505154944:12345-0@lo:502: Request processed in 154us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.533553:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789302442.533673:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505154944:0@lo:502: 00000040:00080000:3.0:1789302442.533761:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789302442.533771:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789302442.534770:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789302442.534782:0:6713:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789302442.534937:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302442.534941:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789302442.534950:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302442.535143:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a690a5919c0) 00000020:00000080:3.0:1789302442.535249:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789302442.535260:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789302442.535553:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6902e2c800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789302442.535562:0:6713:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789302442.535571:0:6713:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x20be524657f11368 00010000:00010000:2.0:1789302442.542779:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789302442.543648:0:6713:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789302442.549155:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789302442.550260:0:6713:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789302442.561178:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789302442.561816:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789302442.564062:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789302442.564080:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302442.564089:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302442.564091:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789302442.564096:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302442.564100:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302442.564102:0:6713:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302442.564112:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302442.564114:0:6713:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789302442.564417:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302442.564423:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302442.564424:0:6713:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789302442.564429:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789302442.565448:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789302442.565486:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789302442.567188:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.567232:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302442.567243:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6902e2c800 from 1 10000000:01000000:3.0:1789302442.567246:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302442.567325:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.567334:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.567348:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302442.567377:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155072:0@lo:101: 00000100:00100000:3.0:1789302442.567472:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302442.567540:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302442.570836:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505155072 00000100:00100000:2.0:1789302442.570856:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505155072 00000100:00100000:2.0:1789302442.570932:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302442.570947:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:6694:x1876219505155072:12345-0@lo:101: 00010000:00010000:2.0:1789302442.570970:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302442.570993:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1136f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.571029:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1136f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.571042:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1136f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.571053:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abe800, rc 0) 00000100:00100000:3.0:1789302442.571945:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155072:0@lo:101: 00010000:00010000:3.0:1789302442.571977:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.571989:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302442.572156:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155200:0@lo:501: 00000100:00100000:3.0:1789302442.572329:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302442.572380:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302442.572575:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155072:12345-0@lo:101: Request processed in 1630us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.572585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302442.572634:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505155200 00000100:00100000:2.0:1789302442.572640:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505155200 00000100:00100000:2.0:1789302442.572692:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789302442.572700:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155200:12345-0@lo:501: 00000100:00100000:2.0:1789302442.573023:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155200:12345-0@lo:501: Request processed in 323us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.573031:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789302442.573073:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155200:0@lo:501: 00000100:00100000:2.0:1789302442.573114:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155328:0@lo:503: 00000100:00100000:2.0:1789302442.574940:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.575008:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302442.575073:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505155328 00000100:00100000:0.0:1789302442.575084:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505155328 00000100:00100000:0.0:1789302442.575153:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789302442.575439:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155328:12345-0@lo:503: 00000100:00100000:0.0:1789302442.575801:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155328:12345-0@lo:503: Request processed in 638us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302442.575809:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789302442.576022:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155328:0@lo:503: 00000040:00080000:2.0:1789302442.576430:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302442.576528:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155456:0@lo:502: 00000100:00100000:2.0:1789302442.576592:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.576634:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302442.576714:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505155456 00000100:00100000:0.0:1789302442.576721:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505155456 00000100:00100000:0.0:1789302442.576768:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789302442.576777:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155456:12345-0@lo:502: 00000100:00100000:0.0:1789302442.577003:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155456:12345-0@lo:502: Request processed in 227us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302442.577011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789302442.577367:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155456:0@lo:502: 00000040:00080000:2.0:1789302442.577750:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789302442.577828:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789302442.577865:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155584:0@lo:502: 00000100:00100000:2.0:1789302442.577928:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.577959:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302442.578050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505155584 00000100:00100000:0.0:1789302442.578058:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505155584 00000100:00100000:0.0:1789302442.578114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789302442.578138:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155584:12345-0@lo:502: 00000100:00100000:0.0:1789302442.578394:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155584:12345-0@lo:502: Request processed in 270us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302442.578402:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789302442.578647:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155584:0@lo:502: 00000040:00080000:2.0:1789302442.578754:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789302442.578767:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789302442.579662:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302442.579675:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302442.579691:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789302442.579699:0:6717:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6902e2c800 00000020:00000080:0.0:1789302442.579702:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302442.579728:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302442.579731:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302442.579733:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789302442.579735:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789302442.579892:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789302442.579915:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302442.579973:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.579998:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302442.580048:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789302442.580052:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6902e2c800 10000000:01000000:2.0:1789302442.580055:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6902e2c800 10000000:01000000:2.0:1789302442.580060:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302442.580066:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6902e2c800 from 1 10000000:01000000:2.0:1789302442.580069:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789302442.580112:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.580130:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.580141:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302442.580175:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155712:0@lo:101: 00000100:00100000:2.0:1789302442.580244:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.580332:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302442.580498:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505155712 00000100:00100000:3.0:1789302442.580507:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505155712 00000100:00100000:3.0:1789302442.580560:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789302442.580571:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505155712:12345-0@lo:101: 00010000:00010000:3.0:1789302442.580588:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302442.580603:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1137d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.580631:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1137d expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.580643:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1137d expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.580653:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6600, rc 0) 00000100:00100000:3.0:1789302442.580696:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505155712:12345-0@lo:101: Request processed in 127us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302442.580703:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789302442.580797:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155712:0@lo:101: 00010000:00010000:2.0:1789302442.580814:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.580823:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302442.580948:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155840:0@lo:501: 00000100:00100000:2.0:1789302442.580976:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.581042:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302442.581237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505155840 00000100:00100000:3.0:1789302442.581242:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505155840 00000100:00100000:3.0:1789302442.581276:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789302442.581314:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505155840:12345-0@lo:501: 00000100:00100000:3.0:1789302442.581617:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505155840:12345-0@lo:501: Request processed in 333us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302442.581625:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789302442.581757:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155840:0@lo:501: 00000100:00100000:0.0:1789302442.581793:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155968:0@lo:503: 00000100:00100000:0.0:1789302442.581836:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302442.581865:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302442.581907:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505155968 00000100:00100000:2.0:1789302442.581912:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505155968 00000100:00100000:2.0:1789302442.581945:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789302442.581952:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505155968:12345-0@lo:503: 00000100:00100000:2.0:1789302442.582130:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505155968:12345-0@lo:503: Request processed in 169us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.582137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789302442.582266:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505155968:0@lo:503: 00000040:00080000:0.0:1789302442.582628:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789302442.582694:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505156096:0@lo:502: 00000100:00100000:0.0:1789302442.582734:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302442.582756:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302442.582835:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505156096 00000100:00100000:3.0:1789302442.582841:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505156096 00000100:00100000:3.0:1789302442.582876:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789302442.582883:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505156096:12345-0@lo:502: 00000100:00100000:3.0:1789302442.583077:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505156096:12345-0@lo:502: Request processed in 193us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302442.583085:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789302442.583278:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505156096:0@lo:502: 00000040:00080000:0.0:1789302442.583589:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789302442.583647:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789302442.583687:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789302442.583741:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789302442.583778:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789302442.583827:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789302442.583861:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789302442.583895:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789302442.583944:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789302442.583983:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789302442.584020:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789302442.584082:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789302442.584630:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789302442.584677:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789302442.584731:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789302442.584766:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789302442.584799:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789302442.584848:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789302442.584884:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789302442.584915:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789302442.584962:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789302442.585000:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789302442.585113:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789302442.585269:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789302442.585711:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789302442.585753:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789302442.585814:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789302442.585853:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789302442.585910:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505156224:0@lo:502: 00000100:00100000:1.0:1789302442.586007:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302442.586402:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904219600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302442.586442:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505156224 00000100:00100000:3.0:1789302442.586453:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505156224 00000100:00100000:3.0:1789302442.586561:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789302442.586572:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505156224:12345-0@lo:502: 00000100:00100000:3.0:1789302442.586847:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505156224:12345-0@lo:502: Request processed in 276us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302442.586855:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789302442.586950:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505156224:0@lo:502: 00000040:00080000:1.0:1789302442.587056:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789302442.587069:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789302442.587847:0:6718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789302442.587869:0:6718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a693ba63380) 00000020:00000080:1.0:1789302442.587897:0:6718:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1789302442.588002:0:6718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6902e2c800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789302442.588018:0:6718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6902e2c800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789302442.588022:0:6718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6902e2c800 3 00010000:00080000:1.0:1789302442.588060:0:6718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a693652a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.142@tcp at head 00010000:00010000:1.0:1789302442.593544:0:6718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789302442.593874:0:6718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789302442.593925:0:6718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789302442.594181:0:6718:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x20be524657f11392 00000100:00080000:1.0:1789302442.594199:0:6718:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302442.594211:0:6718:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a693652a800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789302442.594256:0:6718:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6903e35500 x1876219505156352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302442.594348:0:6718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789302442.594389:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876219505156352:0@lo:38: 00000100:00100000:1.0:1789302442.594446:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302442.594469:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505156480:0@lo:400: 00000100:00100000:2.0:1789302442.594496:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302442.594574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.594613:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505156352 00000100:00100000:2.0:1789302442.594624:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505156352 00000100:00100000:1.0:1789302442.594642:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505156480 00000100:00100000:1.0:1789302442.594652:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505156480 00000100:00100000:2.0:1789302442.594683:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302442.594698:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505156352:12345-0@lo:38: 00000100:00100000:1.0:1789302442.594717:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302442.594729:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505156480:12345-0@lo:400: 00010000:00080000:2.0:1789302442.594734:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:2.0:1789302442.594787:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x20be524657f11399 00000100:00100000:1.0:1789302442.594799:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505156480:12345-0@lo:400: Request processed in 70us (224us total) trans 0 rc 0/0 00000004:00100000:2.0:1789302442.594811:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1789302442.594812:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789302442.594876:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6903e34a80 x1876219505156480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789302442.594880:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a6936398000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302442.594902:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505156480:0@lo:400: 00000100:00100000:2.0:1789302442.594960:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876219505156352:12345-0@lo:38: Request processed in 263us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.594969:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789302442.595024:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6903e35500 x1876219505156352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302442.595052:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302442.595064:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789302442.595076:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789302442.595082:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789302442.595085:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a693652a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789302442.595097:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876219505156352:0@lo:38: 00000040:00080000:1.0:1789302442.595256:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789302442.595721:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789302442.595763:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302442.595796:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302442.595808:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789302442.595873:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789302442.595876:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789302442.595877:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302442.595878:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302442.595879:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302442.595881:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302442.595882:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302442.595884:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302442.595885:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302442.595887:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302442.595888:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302442.595893:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789302442.595895:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302442.595896:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789302442.595897:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302442.595898:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302442.595899:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302442.595900:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302442.595906:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302442.595907:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302442.595908:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302442.595909:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302442.595910:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302442.595936:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789302442.595954:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505156608:0@lo:253: 00000100:00100000:2.0:1789302442.596015:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302442.596060:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505156608 00000100:00100000:2.0:1789302442.596067:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505156608 00000100:00100000:2.0:1789302442.596111:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789302442.596129:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:6694:x1876219505156608:12345-0@lo:253: 20000000:01000000:2.0:1789302442.596224:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789302442.596243:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789302442.600310:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9600 going to sleep for 11 seconds 20000000:01000000:2.0:1789302442.631159:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789302442.631191:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789302442.631255:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789302442.631261:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789302442.631329:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.631353:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba7a00/0x20be524657f112f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f112f1 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.631364:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.631415:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba7a00/0x20be524657f112f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f112f1 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302442.631433:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba7a00/0x20be524657f112f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f112f1 expref: 13 pid: 5840 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302442.631450:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876219505156736:0@lo:104: 00000100:00100000:3.0:1789302442.631537:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302442.631627:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68058153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302442.633990:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505156736 00000100:00100000:1.0:1789302442.634013:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505156736 00000100:00100000:1.0:1789302442.634082:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302442.634094:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:5861:x1876219505156736:12345-0@lo:104: 00010000:00010000:1.0:1789302442.634117:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6900030000/0x20be524657f112f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634263:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789302442.634269:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:5861:x1876219505156736:12345-0@lo:104: Request processed in 179us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302442.634277:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789302442.634325:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302442.634332:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900030000/0x20be524657f112f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634340:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900030000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302442.634366:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030000/0x20be524657f112f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634376:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900030000/0x20be524657f112f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302442.634384:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030000/0x20be524657f112f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302442.634391:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302442.634434:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900030000/0x20be524657f112f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634441:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302442.634465:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900030000/0x20be524657f112f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634472:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900030000/0x20be524657f112f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f112f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634493:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302442.634495:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302442.634497:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302442.634515:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505156864:0@lo:103: 00000100:00100000:1.0:1789302442.634563:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302442.634619:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505156864 00000100:00100000:1.0:1789302442.634624:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505156864 00010000:00010000:1.0:1789302442.634643:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba7a00/0x20be524657f112f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f112f1 expref: 14 pid: 5840 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302442.634665:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302442.634680:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690bb71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+14:3304:x1876219505156864:12345-0@lo:103: 00010000:00010000:1.0:1789302442.634694:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302442.634700:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba7a00/0x20be524657f112f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f112f1 expref: 14 pid: 5840 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634712:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba7a00/0x20be524657f112f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f112f1 expref: 14 pid: 5840 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634733:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634743:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789302442.634762:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003502174s 00010000:00010000:1.0:1789302442.634768:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634776:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634782:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634789:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634793:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302442.634798:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634806:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634820:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.634830:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302442.634876:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690bb71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+14:3304:x1876219505156864:12345-0@lo:103: Request processed in 197us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302442.634882:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302442.634961:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505156864:0@lo:103: 00010000:00010000:1.0:1789302442.634998:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7a00/0x20be524657f112f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f112f1 expref: 13 pid: 5840 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302442.635010:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876219505156736:0@lo:104: 00010000:00010000:1.0:1789302442.635025:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.635037:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.635042:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302442.635048:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7e00/0x20be524657f113a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302442.641507:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:6694:x1876219505156608:12345-0@lo:253: Request processed in 45373us (45477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302442.641529:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302442.641730:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:6694:1876219505156608:0@lo:253: 10000000:01000000:1.0:1789302442.641752:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789302442.641755:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789302442.641757:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789302442.641777:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302442.641778:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302442.641780:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302442.641781:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302442.641783:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302442.641785:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789302442.641786:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789302442.641788:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302442.641790:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789302442.641810:0:6694:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789302442.646907:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789302442.647096:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789302442.647457:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789302442.647652:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789302442.647870:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789302442.648149:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789302442.649433:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789302442.888730:0:6694:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789302442.888740:0:6694:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789302442.888783:0:6694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789302442.888857:0:6694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789302442.888882:0:6694:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789302442.888922:0:6694:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789302443.088589:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302444.109500:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789302444.942174:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789302444.942185:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6905909800 from 21 10000000:01000000:1.0:1789302444.942192:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789302444.942253:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302444.942267:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302444.942281:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302444.942328:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505156992:0@lo:101: 00000100:00100000:1.0:1789302444.942420:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302444.942479:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505156992 00000100:00100000:0.0:1789302444.942489:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505156992 00000100:00100000:1.0:1789302444.942491:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.942559:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789302444.942570:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505156992:12345-0@lo:101: 00010000:00010000:0.0:1789302444.942587:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302444.942603:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f113a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.942632:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f113a7 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.942646:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f113a7 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.942658:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6900030800, rc 0) 00000100:00100000:0.0:1789302444.942704:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505156992:12345-0@lo:101: Request processed in 136us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.942712:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789302444.943576:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505156992:0@lo:101: 00010000:00010000:1.0:1789302444.943618:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302444.943631:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302444.943702:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157120:0@lo:501: 00000100:00100000:1.0:1789302444.943741:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302444.943777:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.943850:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505157120 00000100:00100000:0.0:1789302444.943856:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505157120 00000100:00100000:0.0:1789302444.943903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789302444.943917:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505157120:12345-0@lo:501: 00000100:00100000:0.0:1789302444.944281:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505157120:12345-0@lo:501: Request processed in 370us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.944322:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789302444.945718:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157120:0@lo:501: 00000100:00100000:1.0:1789302444.945794:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157248:0@lo:503: 00000100:00100000:1.0:1789302444.945881:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302444.945936:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.947213:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505157248 00000100:00100000:0.0:1789302444.947243:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505157248 00000100:00100000:0.0:1789302444.947342:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789302444.947354:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505157248:12345-0@lo:503: 00000100:00100000:0.0:1789302444.947727:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505157248:12345-0@lo:503: Request processed in 374us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.947736:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789302444.947936:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157248:0@lo:503: 00000100:00100000:1.0:1789302444.952558:0:6824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6824:1876219505157376:0@lo:502: 00000100:00100000:1.0:1789302444.952678:0:6824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302444.952728:0:6824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a691893c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.952839:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505157376 00000100:00100000:0.0:1789302444.952850:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505157376 00000100:00100000:0.0:1789302444.952912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789302444.952923:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:6824:x1876219505157376:12345-0@lo:502: 00000100:00100000:0.0:1789302444.953263:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:6824:x1876219505157376:12345-0@lo:502: Request processed in 340us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.953270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302444.953781:0:6824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6824:1876219505157376:0@lo:502: 00000100:00100000:1.0:1789302444.953850:0:6824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6824:1876219505157504:0@lo:502: 00000100:00100000:1.0:1789302444.953896:0:6824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302444.953932:0:6824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a691893c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.954676:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505157504 00000100:00100000:0.0:1789302444.954688:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505157504 00000100:00100000:0.0:1789302444.954744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789302444.954754:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:6824:x1876219505157504:12345-0@lo:502: 00000100:00100000:0.0:1789302444.959197:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:6824:x1876219505157504:12345-0@lo:502: Request processed in 4429us (5285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.959228:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789302444.971378:0:6824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6824:1876219505157504:0@lo:502: 00000040:00080000:3.0:1789302444.971494:0:6824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789302444.971650:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789302444.971676:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789302444.971690:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302444.971717:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302444.971729:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789302444.971732:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6905909800 from 4 10000000:01000000:1.0:1789302444.971739:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789302444.971785:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302444.971794:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302444.971805:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302444.971828:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157632:0@lo:101: 00000100:00100000:1.0:1789302444.971907:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302444.971954:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505157632 00000100:00100000:3.0:1789302444.971963:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505157632 00000100:00100000:1.0:1789302444.971963:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a691893c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302444.972020:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789302444.972030:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505157632:12345-0@lo:101: 00010000:00010000:3.0:1789302444.972046:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302444.972062:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f113b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302444.972212:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f113b5 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302444.972237:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f113b5 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302444.972248:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302444.972355:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505157632:12345-0@lo:101: Request processed in 326us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302444.972362:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789302444.972733:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157632:0@lo:101: 00010000:00010000:1.0:1789302444.972750:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302444.972761:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302444.972822:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157760:0@lo:256: 00000100:00100000:1.0:1789302444.972860:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302444.972896:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a691893c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.973186:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505157760 00000100:00100000:0.0:1789302444.973194:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505157760 00000100:00100000:0.0:1789302444.973231:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789302444.973241:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505157760:12345-0@lo:256: 20000000:01000000:0.0:1789302444.973261:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789302444.973280:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789302444.973309:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789302444.973400:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505157760:12345-0@lo:256: Request processed in 160us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.973407:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789302444.974244:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157760:0@lo:256: 10000000:01000000:3.0:1789302444.974363:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789302444.974373:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302444.974384:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302444.974398:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789302444.974401:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789302444.974404:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789302444.974436:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302444.974443:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302444.974453:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302444.974471:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157888:0@lo:101: 00000100:00100000:3.0:1789302444.974519:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302444.974606:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815840 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.984759:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505157888 00000100:00100000:0.0:1789302444.984780:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505157888 00000100:00100000:0.0:1789302444.984851:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789302444.984865:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505157888:12345-0@lo:101: 00010000:00010000:0.0:1789302444.984888:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302444.984915:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f113c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.984955:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f113c3 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.984971:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f113c3 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.984982:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6900030c00, rc 0) 00000100:00100000:0.0:1789302444.985096:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505157888:12345-0@lo:101: Request processed in 234us (10576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.985125:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789302444.985239:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beaad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505157888:0@lo:101: 00010000:00010000:0.0:1789302444.985263:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302444.985275:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302444.985381:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505158016:0@lo:501: 00000100:00100000:0.0:1789302444.985416:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302444.985449:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302444.989452:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505158016 00000100:00100000:1.0:1789302444.989475:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505158016 00000100:00100000:1.0:1789302444.989559:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789302444.989571:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505158016:12345-0@lo:501: 00000100:00100000:1.0:1789302444.989969:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505158016:12345-0@lo:501: Request processed in 399us (4550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302444.989978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789302444.990373:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505158016:0@lo:501: 00000100:00100000:0.0:1789302444.990441:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505158144:0@lo:503: 00000100:00100000:0.0:1789302444.990496:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302444.990537:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.990556:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505158144 00000100:00100000:0.0:1789302444.990561:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505158144 00000100:00100000:0.0:1789302444.992659:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789302444.992682:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505158144:12345-0@lo:503: 00000100:00100000:0.0:1789302444.993087:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505158144:12345-0@lo:503: Request processed in 412us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.993097:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789302444.994384:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505158144:0@lo:503: 00000100:00100000:1.0:1789302444.994850:0:6827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6827:1876219505158272:0@lo:502: 00000100:00100000:1.0:1789302444.994936:0:6827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302444.994988:0:6827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a691893c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302444.995051:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505158272 00000100:00100000:0.0:1789302444.995060:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505158272 00000100:00100000:0.0:1789302444.995125:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789302444.995135:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+15:6827:x1876219505158272:12345-0@lo:502: 00000100:00100000:0.0:1789302444.996754:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+15:6827:x1876219505158272:12345-0@lo:502: Request processed in 1609us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302444.996771:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789302445.002614:0:6827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6827:1876219505158272:0@lo:502: 00000020:01000000:1.0:1789302445.002691:0:6827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789302445.002703:0:6827:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789302445.002712:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302445.002714:0:6827:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789302445.002721:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789302445.002726:0:6827:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:1.0:1789302445.002761:0:6827:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789302445.002764:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302445.002786:0:6827:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a693ba60000) 00000020:00000080:1.0:1789302445.002813:0:6827:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789302445.002819:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789302445.002918:0:6827:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789302445.002924:0:6827:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789302445.002933:0:6827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f113d8 00010000:00080000:1.0:1789302445.002968:0:6827:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6936529800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:1.0:1789302445.003247:0:6827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789302445.101886:0:6827:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789302445.101930:0:6827:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789302445.102775:0:6827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302445.103057:0:6827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302445.105178:0:6827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789302445.105325:0:6827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789302445.112654:0:6835:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302445.112664:0:6835:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789302445.124976:0:6827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789302445.124997:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789302445.125048:0:6827:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789302445.125236:0:6827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f113df 00000100:00080000:0.0:1789302445.125251:0:6827:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789302445.125266:0:6827:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6936529800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789302445.125393:0:6827:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6935d1b480 x1876219505158400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789302445.125424:0:6827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789302445.125452:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505158400:0@lo:8: 00000020:01000000:0.0:1789302445.125497:0:6827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302445.125504:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302445.125506:0:6827:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789302445.125510:0:6827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302445.125516:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302445.125517:0:6827:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302445.125522:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302445.125525:0:6827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789302445.125550:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302445.125560:0:6827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6827:1876219505158528:0@lo:502: 00000100:00100000:0.0:1789302445.125624:0:6827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302445.125647:0:6827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903e46d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302445.125674:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505158528 00000100:00100000:0.0:1789302445.125682:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505158528 00000100:00100000:2.0:1789302445.125708:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505158400 00000100:00100000:2.0:1789302445.125714:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505158400 00000100:00100000:0.0:1789302445.125738:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789302445.125746:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302445.125752:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:6827:x1876219505158528:12345-0@lo:502: 00000100:00100000:2.0:1789302445.125757:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1876219505158400:12345-0@lo:8: 00010000:00080000:2.0:1789302445.125794:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1789302445.125831:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f113e6 00002000:00100000:2.0:1789302445.125877:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a693639f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789302445.125882:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789302445.125887:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789302445.126068:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789302445.126114:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505158784:0@lo:400: 00002000:00080000:2.0:1789302445.126635:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789302445.126670:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9a6927ba1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302445.132517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302445.132607:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302445.132791:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505158784 00000100:00100000:1.0:1789302445.132860:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505158784 00000100:00100000:3.0:1789302445.132877:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505158656:0@lo:400: 00000100:00100000:3.0:1789302445.132923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302445.132968:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505158656 00000100:00100000:1.0:1789302445.132973:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505158656 00000100:00100000:3.0:1789302445.132982:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302445.132995:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505158784:12345-0@lo:400: 00000100:00100000:1.0:1789302445.133003:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302445.133013:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505158656:12345-0@lo:400: 00000100:00100000:3.0:1789302445.133114:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505158784:12345-0@lo:400: Request processed in 114us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302445.133122:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302445.133208:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:6827:x1876219505158528:12345-0@lo:502: Request processed in 7458us (7583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302445.133225:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1789302445.133255:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a690328e300 x1876219505158656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789302445.133269:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302445.133273:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505158656:0@lo:400: 00010000:00080000:3.0:1789302445.133319:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a690328df80 x1876219505158784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302445.133330:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505158784:0@lo:400: 00000100:00100000:0.0:1789302445.133405:0:6827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:6827:1876219505158528:0@lo:502: 00000020:01000000:0.0:1789302445.133444:0:6827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302445.133453:0:6827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302445.133456:0:6827:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000100:00100000:1.0:1789302445.133586:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505158656:12345-0@lo:400: Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.133595:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1789302445.134157:0:6827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789302445.134487:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789302445.134513:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789302445.134526:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302445.134540:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302445.134552:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789302445.134556:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a690a593380 from 1 10000000:01000000:1.0:1789302445.134559:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789302445.134605:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302445.134614:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302445.134635:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302445.134659:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505158912:0@lo:101: 00000100:00100000:1.0:1789302445.134717:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302445.134785:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302445.135043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505158912 00000100:00100000:0.0:1789302445.135053:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505158912 00000100:00100000:0.0:1789302445.135197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789302445.135208:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505158912:12345-0@lo:101: 00010000:00010000:0.0:1789302445.135223:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302445.135239:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f113ed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302445.135269:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f113ed expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302445.135282:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f113ed expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302445.135310:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6900030e00, rc 0) 00000100:00100000:0.0:1789302445.136241:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505158912:12345-0@lo:101: Request processed in 1029us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302445.136249:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:1.0:1789302445.138762:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302445.139490:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505158912:0@lo:101: 00010000:00010000:0.0:1789302445.139530:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302445.139565:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302445.139676:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505159040:0@lo:501: 00000100:00100000:0.0:1789302445.139762:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302445.139818:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903e46480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302445.139845:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505159040 00000100:00100000:0.0:1789302445.139854:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505159040 00000100:00100000:0.0:1789302445.139916:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789302445.139928:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505159040:12345-0@lo:501: 00010000:00080000:3.0:1789302445.142409:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d1b480 x1876219505158400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302445.142429:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789302445.142443:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789302445.142455:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789302445.142463:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789302445.142467:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a6936529800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789302445.142487:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789302445.142496:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505158400:0@lo:8: 00000100:00100000:0.0:1789302445.142530:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505159040:12345-0@lo:501: Request processed in 2601us (2766us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302445.142549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789302445.142613:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505159040:0@lo:501: 10000000:01000000:0.0:1789302445.142653:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789302445.142663:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302445.142676:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789302445.143559:0:6835:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789302445.143688:0:6835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 156329401549ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789302445.148655:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876219505158400:12345-0@lo:8: Request processed in 15345us (15550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.148687:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1789302445.232405:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789302445.232660:0:6836:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789302445.232696:0:6836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1876219505159296:0@lo:7: 00000100:00100000:3.0:1789302445.232808:0:6836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302445.232889:0:6836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302445.233034:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505159168:0@lo:13: 00000100:00100000:0.0:1789302445.233075:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302445.233163:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505159296 00000100:00100000:0.0:1789302445.233172:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505159296 00000100:00100000:0.0:1789302445.233233:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302445.233244:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6836:x1876219505159296:12345-0@lo:7: 00000100:00100000:0.0:1789302445.233696:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505159168 00000100:00100000:0.0:1789302445.233702:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505159168 00000100:00100000:0.0:1789302445.233731:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302445.233739:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505159168:12345-0@lo:13: 00002000:00000024:0.0:1789302445.233766:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789302445.233827:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505159168:12345-0@lo:13: Request processed in 87us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302445.233835:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789302445.233860:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302445.234458:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a693bea9500 x1876219505159168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302445.234485:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505159168:0@lo:13: 00002000:00080000:0.0:1789302445.282243:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789302445.282261:0:6699:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789302445.283118:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6836:x1876219505159296:12345-0@lo:7: Request processed in 49858us (50292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302445.283345:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789302445.283978:0:6836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a693beab480 x1876219505159296/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789302461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302445.283998:0:6836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1876219505159296:0@lo:7: 00000004:00080000:0.0:1789302445.284561:0:6836:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789302445.285093:0:6836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1876219505159424:0@lo:5: 00000100:00100000:0.0:1789302445.286253:0:6836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302445.287663:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505159424 00000100:00100000:3.0:1789302445.287681:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505159424 00000100:00100000:1.0:1789302445.287845:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302445.287861:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6836:x1876219505159424:12345-0@lo:5: 00002000:00080000:1.0:1789302445.287906:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789302445.287911:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789302445.288438:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6836:x1876219505159424:12345-0@lo:5: Request processed in 580us (2188us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789302445.288446:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302445.293775:0:6836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906349000 going to sleep for 11 seconds 00010000:00080000:0.0:1789302445.294742:0:6836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d1b800 x1876219505159424/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302445.294793:0:6836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1876219505159424:0@lo:5: 00000004:00080000:0.0:1789302445.294818:0:6836:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789302445.295958:0:6836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1876219505159552:0@lo:700: 00000100:00100000:0.0:1789302445.296330:0:6836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302445.297162:0:6836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906349000 going to sleep for 11 seconds 00000100:00100000:2.0:1789302445.305389:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505159552 00000100:00100000:2.0:1789302445.305424:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505159552 00000100:00100000:2.0:1789302445.305507:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302445.305521:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6836:x1876219505159552:12345-0@lo:700: 00000100:00100000:2.0:1789302445.305612:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1876219505159680:0@lo:700: 00000100:00100000:2.0:1789302445.305709:0:6705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302445.305759:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904219900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302445.306124:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505159680 00000100:00100000:1.0:1789302445.306130:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505159680 00000100:00100000:1.0:1789302445.306252:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302445.306263:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1876219505159680:12345-0@lo:700: 40000000:02000000:0.0:1789302445.388391:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789302445.402219:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1876219505159680:12345-0@lo:700: Request processed in 95944us (96496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302445.402238:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789302445.403564:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a690328f100 x1876219505159680/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789302461 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302445.403603:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1876219505159680:0@lo:700: 40000000:02000000:3.0:1789302445.403623:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1789302445.516242:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6836:x1876219505159552:12345-0@lo:700: Request processed in 210705us (219894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302445.516261:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789302445.516370:0:6836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d1aa00 x1876219505159552/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789302461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302445.516390:0:6836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1876219505159552:0@lo:700: 00000001:00080000:3.0:1789302445.518439:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789302445.518472:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1789302445.582934:0:6836:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789302445.587419:0:6836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1876219505159808:0@lo:5: 00000100:00100000:2.0:1789302445.587549:0:6836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302445.587719:0:6836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690873b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302445.587819:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505159808 00000100:00100000:3.0:1789302445.587830:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505159808 00000100:00100000:3.0:1789302445.587902:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302445.587914:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6836:x1876219505159808:12345-0@lo:5: 00002000:00080000:2.0:1789302445.606891:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789302445.606929:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789302445.620332:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6836:x1876219505159808:12345-0@lo:5: Request processed in 32371us (32734us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789302445.620351:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789302445.623463:0:6836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a690328e680 x1876219505159808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302461 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302445.623486:0:6836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789302445.623506:0:6836:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a690328e680 x1876219505159808/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302461 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302445.623520:0:6836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6836:1876219505159808:0@lo:5: 00000004:00080000:0.0:1789302445.623542:0:6836:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789302446.157689:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302447.182595:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302448.206983:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302449.233357:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302450.256570:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302450.582646:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505159936:0@lo:400: 00000100:00100000:2.0:1789302450.582727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.582784:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302450.582791:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505160320:0@lo:400: 00000100:00100000:2.0:1789302450.582820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.582855:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505160064:0@lo:400: 00000100:00100000:2.0:1789302450.582881:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.582900:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302450.582906:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505160192:0@lo:400: 00000100:00100000:2.0:1789302450.582929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302450.582962:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505160064 00000100:00100000:2.0:1789302450.582971:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505160064 00000100:00100000:2.0:1789302450.583014:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505160192 00000100:00100000:2.0:1789302450.583017:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505160192 00000100:00100000:2.0:1789302450.583048:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302450.583058:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505160064:12345-0@lo:400: 00000100:00100000:2.0:1789302450.583130:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505160064:12345-0@lo:400: Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.583137:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302450.583154:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302450.583176:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505160192:12345-0@lo:400: 00000100:00100000:2.0:1789302450.583219:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505160192:12345-0@lo:400: Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.583225:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789302450.583268:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a690328d500 x1876219505160192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302450.583283:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505160192:0@lo:400: 00010000:00080000:2.0:1789302450.583336:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a690328dc00 x1876219505160064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302450.583345:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505160064:0@lo:400: 00000100:00100000:2.0:1789302450.583392:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505160320 00000100:00100000:2.0:1789302450.583396:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505160320 00000100:00100000:2.0:1789302450.583425:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302450.583431:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876219505160320:12345-0@lo:400: 00000100:00100000:2.0:1789302450.583465:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876219505160320:12345-0@lo:400: Request processed in 34us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302450.583470:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789302450.583492:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a690328f100 x1876219505160320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302450.583501:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505160320:0@lo:400: 00000100:00100000:0.0:1789302450.583862:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302450.583874:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505160448:0@lo:13: 00000100:00100000:0.0:1789302450.583906:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302450.583939:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505159936 00000100:00100000:0.0:1789302450.583943:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505159936 00000100:00100000:0.0:1789302450.584018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789302450.584025:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+16:3304:x1876219505159936:12345-0@lo:400: 00000100:00100000:0.0:1789302450.584059:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+16:3304:x1876219505159936:12345-0@lo:400: Request processed in 35us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302450.584075:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789302450.584113:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302450.584127:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302450.584147:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505160448 00000100:00100000:0.0:1789302450.584151:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505160448 00000100:00100000:0.0:1789302450.584175:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302450.584182:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876219505160448:12345-0@lo:13: 00002000:00000024:0.0:1789302450.584218:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302450.584256:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876219505160448:12345-0@lo:13: Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302450.584262:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789302450.584310:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d1b800 x1876219505160448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302450.584326:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505160448:0@lo:13: 00000100:00100000:2.0:1789302450.585061:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505159936:0@lo:400: 00000001:02000400:0.0:1789302450.611176:0:7066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:1.0:1789302450.679037:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789302451.280729:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302452.301640:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302453.325640:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302454.349454:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302455.373492:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302455.694005:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505160576:0@lo:400: 00000100:00100000:3.0:1789302455.694111:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.694271:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302455.694302:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505160832:0@lo:13: 00000100:00100000:2.0:1789302455.694340:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505160704:0@lo:400: 00000100:00100000:1.0:1789302455.694345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302455.694398:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505160832 00000100:00100000:1.0:1789302455.694407:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505160832 00000100:00100000:2.0:1789302455.694414:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302455.694448:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505160704 00000100:00100000:2.0:1789302455.694469:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505160704 00000100:00100000:1.0:1789302455.694477:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302455.694488:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505160832:12345-0@lo:13: 00000100:00100000:2.0:1789302455.694500:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302455.694505:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505160704:12345-0@lo:400: 00002000:00000024:1.0:1789302455.694544:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302455.694564:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505160704:12345-0@lo:400: Request processed in 57us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302455.694572:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302455.694577:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505160832:12345-0@lo:13: Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.694582:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789302455.694595:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302455.694618:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d1aa00 x1876219505160704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789302455.694618:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6903e34000 x1876219505160832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302455.694631:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789302455.694635:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505160704:0@lo:400: 00000100:00100000:1.0:1789302455.694651:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505160832:0@lo:13: 00000100:00100000:1.0:1789302455.694687:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505160576 00000100:00100000:1.0:1789302455.694691:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505160576 00000100:00100000:1.0:1789302455.694715:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789302455.694720:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:3305:x1876219505160576:12345-0@lo:400: 00000100:00100000:0.0:1789302455.695223:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302455.695234:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505160960:0@lo:400: 00000100:00100000:0.0:1789302455.695273:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302455.695324:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505160960 00000100:00100000:0.0:1789302455.695329:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505160960 00000100:00100000:0.0:1789302455.695363:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302455.695370:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505160960:12345-0@lo:400: 00000100:00100000:0.0:1789302455.695406:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505160960:12345-0@lo:400: Request processed in 36us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302455.695412:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789302455.695444:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d1b480 x1876219505160960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302455.695455:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505160960:0@lo:400: 00000100:00100000:1.0:1789302455.701248:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:3305:x1876219505160576:12345-0@lo:400: Request processed in 6509us (7119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302455.701267:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789302455.701563:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302455.703907:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505160576:0@lo:400: 00010000:00010000:1.0:1789302456.397510:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302457.423475:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302458.446634:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302459.471418:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302460.494906:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302460.814106:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505161344:0@lo:400: 00000100:00100000:0.0:1789302460.814205:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302460.814282:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302460.814310:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505161472:0@lo:400: 00000100:00100000:0.0:1789302460.814337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302460.814381:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505161344 00000100:00100000:0.0:1789302460.814390:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505161344 00000100:00100000:0.0:1789302460.814454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789302460.814464:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505161344:12345-0@lo:400: 00000100:00100000:0.0:1789302460.814525:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505161344:12345-0@lo:400: Request processed in 62us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.814532:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789302460.814559:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505161472 00000100:00100000:0.0:1789302460.814562:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505161472 00000100:00100000:0.0:1789302460.814587:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302460.814592:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505161472:12345-0@lo:400: 00000100:00100000:0.0:1789302460.814619:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505161472:12345-0@lo:400: Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.814624:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789302460.814667:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d1a680 x1876219505161472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302460.814682:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505161472:0@lo:400: 00010000:00080000:0.0:1789302460.814795:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d18380 x1876219505161344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302460.814805:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505161344:0@lo:400: 00000100:00100000:1.0:1789302460.814936:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505161216:0@lo:400: 00000100:00100000:1.0:1789302460.814986:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302460.815017:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302460.815023:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505161088:0@lo:400: 00000100:00100000:1.0:1789302460.815057:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789302460.815083:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302460.815089:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302460.815127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505161216 00000100:00100000:1.0:1789302460.815130:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505161216 00000100:00100000:1.0:1789302460.815161:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302460.815168:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505161216:12345-0@lo:400: 00000100:00100000:1.0:1789302460.815205:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505161216:12345-0@lo:400: Request processed in 37us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.815212:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789302460.815241:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6935d19180 x1876219505161216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302460.815252:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505161216:0@lo:400: 00000100:00100000:1.0:1789302460.815260:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302460.815267:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505161600:0@lo:13: 00000100:00100000:1.0:1789302460.815311:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302460.815335:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505161600 00000100:00100000:1.0:1789302460.815338:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505161600 00000100:00100000:1.0:1789302460.815360:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302460.815366:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505161600:12345-0@lo:13: 00002000:00000024:1.0:1789302460.815396:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302460.815427:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505161600:12345-0@lo:13: Request processed in 62us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302460.815433:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789302460.815469:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6903e37b80 x1876219505161600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302460.815482:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505161600:0@lo:13: 00000100:00100000:0.0:1789302460.817683:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505161088 00000100:00100000:0.0:1789302460.817718:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505161088 00000100:00100000:0.0:1789302460.817783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302460.817794:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:3306:x1876219505161088:12345-0@lo:400: 00000100:00100000:0.0:1789302460.817909:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:3306:x1876219505161088:12345-0@lo:400: Request processed in 116us (2850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302460.817916:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789302460.818161:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505161088:0@lo:400: 00010000:00010000:2.0:1789302461.518495:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302462.549151:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789302462.965350:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789302462.965355:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789302462.965584:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a6936077800 00000020:01000004:2.0:1789302462.965605:0:7636:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789302462.965622:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789302462.965641:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a6908ca99c0) 00000020:00000080:2.0:1789302462.965661:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789302462.992229:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789302462.992598:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789302463.021248:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789302463.028614:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789302463.028656:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789302463.028735:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789302463.028764:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789302463.029257:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789302463.029272:0:7636:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789302463.029333:0:7636:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x20be524657f11402 00000020:01000004:2.0:1789302463.029344:0:7636:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789302463.029374:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789302463.029379:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789302463.029385:0:7636:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789302463.029605:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789302463.029612:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789302463.068515:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789302463.069033:0:7636:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.142@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789302463.069039:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789302463.069041:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789302463.069043:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302463.069044:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302463.069045:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302463.069047:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302463.069048:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302463.069050:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789302463.069051:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789302463.069053:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302463.069055:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789302463.069064:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789302463.069066:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789302463.069068:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789302463.069069:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302463.069070:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302463.069070:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302463.069071:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302463.069072:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302463.069073:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789302463.069074:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789302463.069075:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302463.069076:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789302463.069114:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789302463.069149:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505161728:0@lo:253: 00000100:00100000:3.0:1789302463.069247:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.069349:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302463.069365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505161728 00000100:00100000:1.0:1789302463.069375:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505161728 00000100:00100000:1.0:1789302463.069441:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789302463.069452:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:7636:x1876219505161728:12345-0@lo:253: 20000000:01000000:1.0:1789302463.069492:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789302463.069497:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789302463.069503:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789302463.069507:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789302463.071972:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302463.074919:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789302463.074958:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789302463.077571:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789302463.077603:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789302463.077668:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789302463.079128:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789302463.081155:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789302463.081259:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:1.0:1789302463.081262:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:1.0:1789302463.081368:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789302463.081377:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789302463.082736:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789302463.082756:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:1.0:1789302463.082807:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789302463.082817:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789302463.082848:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789302463.082928:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789302463.083977:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789302463.084016:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.142@tcp 20000000:01000000:1.0:1789302463.084279:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.142@tcp (null) (null) (null) 00000040:00080000:1.0:1789302463.084370:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789302463.084379:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789302463.084579:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789302463.084588:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.142@tcp (null) (null) 00000040:00080000:1.0:1789302463.084621:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789302463.084632:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789302463.084700:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789302463.084738:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789302463.084755:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789302463.084759:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789302463.084763:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789302463.084779:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789302463.084782:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789302463.084825:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789302463.084828:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789302463.096058:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789302463.096507:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789302463.096572:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789302463.096659:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789302463.096673:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789302463.096676:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789302463.099734:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789302463.099858:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789302463.099919:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789302463.100480:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789302463.100539:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789302463.100630:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789302463.100645:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789302463.100649:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789302463.101899:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789302463.101970:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789302463.102037:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789302463.105517:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789302463.105596:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789302463.105637:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789302463.105655:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789302463.105658:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789302463.110894:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789302463.111159:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789302463.111199:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789302463.113226:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789302463.113318:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789302463.113418:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789302463.113440:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789302463.113442:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789302463.113454:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789302463.113487:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.113515:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11353 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114152:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1137d expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114160:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f113a7 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114167:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f113c3 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114200:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f113ed expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114208:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114262:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f113ed expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114378:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f113ed expref: 16 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.114400:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505161856:0@lo:104: 00000100:00100000:0.0:1789302463.114494:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302463.114577:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f113c3 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114585:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f113c3 expref: 16 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.114593:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505161984:0@lo:104: 00010000:00010000:0.0:1789302463.114619:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f113a7 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114627:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f113a7 expref: 16 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.114634:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505162112:0@lo:104: 00010000:00010000:0.0:1789302463.114675:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1137d expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114689:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1137d expref: 16 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.114697:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505162240:0@lo:104: 00010000:00010000:0.0:1789302463.114724:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f11353 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.114733:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f11353 expref: 16 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.114741:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505162368:0@lo:104: 00000100:00100000:0.0:1789302463.114759:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302463.115135:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789302463.115161:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.115190:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.115199:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.115208:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.115228:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505161856 00000100:00100000:3.0:1789302463.115238:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505161856 00000100:00100000:3.0:1789302463.115314:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505161984 00000100:00100000:3.0:1789302463.115318:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505161984 00000100:00100000:3.0:1789302463.115330:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505162112 00000100:00100000:3.0:1789302463.115333:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505162112 00000100:00100000:3.0:1789302463.115342:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505162240 00000100:00100000:3.0:1789302463.115344:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505162240 00000100:00100000:3.0:1789302463.115355:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505162368 00000100:00100000:3.0:1789302463.115357:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505162368 00000100:00100000:3.0:1789302463.115369:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789302463.115379:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+7:5839:x1876219505161856:12345-0@lo:104: 00010000:00010000:3.0:1789302463.115397:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.115486:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302463.115493:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+7:5839:x1876219505161856:12345-0@lo:104: Request processed in 116us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.115501:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789302463.115546:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789302463.115552:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+6:5839:x1876219505161984:12345-0@lo:104: 00010000:00010000:3.0:1789302463.115561:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.115594:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789302463.115598:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+6:5839:x1876219505161984:12345-0@lo:104: Request processed in 48us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.115604:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789302463.115616:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789302463.115621:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+5:5839:x1876219505162112:12345-0@lo:104: 00010000:00010000:3.0:1789302463.115628:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.115652:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789302463.115657:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+5:5839:x1876219505162112:12345-0@lo:104: Request processed in 37us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.115662:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789302463.115672:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789302463.115677:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:5839:x1876219505162240:12345-0@lo:104: 00010000:00010000:3.0:1789302463.115683:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.115718:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789302463.115722:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:5839:x1876219505162240:12345-0@lo:104: Request processed in 46us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.115728:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789302463.115740:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789302463.115746:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:5839:x1876219505162368:12345-0@lo:104: 00010000:00010000:3.0:1789302463.115753:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.115776:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789302463.115780:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:5839:x1876219505162368:12345-0@lo:104: Request processed in 35us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.115786:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789302463.115931:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789302463.115938:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.115946:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8800 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302463.115950:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.115960:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302463.115968:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302463.115975:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302463.116107:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116114:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302463.116136:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116144:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c8800/0x20be524657f113ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116161:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789302463.116165:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116171:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302463.116175:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116182:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302463.116188:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302463.116193:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302463.116205:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116211:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302463.116229:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116246:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f113c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116256:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789302463.116259:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116265:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302463.116269:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116275:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302463.116281:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302463.116310:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302463.116325:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116331:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302463.116337:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116344:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f113a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113ae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116352:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302463.116362:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116368:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6923abe000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302463.116370:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116376:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302463.116382:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302463.116386:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302463.116399:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116405:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302463.116412:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116418:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6923abe000/0x20be524657f1137d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11384 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116426:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302463.116429:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116435:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6e00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302463.116437:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116454:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302463.116461:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302463.116466:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302463.116478:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116484:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302463.116488:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116495:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f11353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1135a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.116509:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302463.116511:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302463.116513:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302463.116531:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505162880:0@lo:103: 00000100:00100000:3.0:1789302463.116574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.116604:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789302463.116610:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505162496:0@lo:103: 00000100:00100000:3.0:1789302463.116629:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.116642:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505163008:0@lo:103: 00000100:00100000:3.0:1789302463.116677:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.116708:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505162624:0@lo:103: 00000100:00100000:3.0:1789302463.116750:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.116770:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302463.116775:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505162752:0@lo:103: 00000100:00100000:3.0:1789302463.116794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.116819:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505162880 00000100:00100000:1.0:1789302463.116957:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505162496 00000100:00100000:1.0:1789302463.116971:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505162496 00010000:00010000:1.0:1789302463.117016:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f113ed expref: 17 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302463.117037:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505163008 00000100:00100000:1.0:1789302463.117040:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505163008 00010000:00010000:1.0:1789302463.117051:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11353 expref: 18 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302463.117061:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505162624 00000100:00100000:1.0:1789302463.117063:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505162624 00010000:00010000:1.0:1789302463.117075:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f113c3 expref: 19 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302463.117083:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505162752 00000100:00100000:1.0:1789302463.117086:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505162752 00010000:00010000:1.0:1789302463.117096:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f113a7 expref: 20 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302463.117109:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789302463.117116:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505162496:12345-0@lo:103: 00010000:00010000:1.0:1789302463.117129:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302463.117135:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f113ed expref: 20 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.117146:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f113ed expref: 20 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.117164:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302463.117203:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505162496:12345-0@lo:103: Request processed in 88us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.117210:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789302463.117234:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302463.117240:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505163008:12345-0@lo:103: 00010000:00010000:1.0:1789302463.117247:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302463.117252:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11353 expref: 19 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.117259:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f11353 expref: 19 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.117268:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302463.117306:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505163008:12345-0@lo:103: Request processed in 66us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.117312:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302463.117324:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302463.117330:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+18:3303:x1876219505162624:12345-0@lo:103: 00010000:00010000:1.0:1789302463.117337:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302463.117341:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f113c3 expref: 18 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.117348:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f113c3 expref: 18 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.117357:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302463.117381:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+18:3303:x1876219505162624:12345-0@lo:103: Request processed in 52us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.117387:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302463.117399:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302463.117405:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+17:3303:x1876219505162752:12345-0@lo:103: 00010000:00010000:1.0:1789302463.117412:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302463.117421:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f113a7 expref: 17 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.117429:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f113a7 expref: 17 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.117438:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302463.117461:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+17:3303:x1876219505162752:12345-0@lo:103: Request processed in 56us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.117468:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302463.117508:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505162752:0@lo:103: 00000100:00100000:1.0:1789302463.117517:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505162624:0@lo:103: 00000100:00100000:1.0:1789302463.117545:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505162496:0@lo:103: 00000100:00100000:1.0:1789302463.117553:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505163008:0@lo:103: 00010000:00010000:0.0:1789302463.118260:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900030e00/0x20be524657f113f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f113ed expref: 16 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.118276:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505161856:0@lo:104: 00010000:00010000:0.0:1789302463.118342:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900030c00/0x20be524657f113ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f113c3 expref: 15 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.118352:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505161984:0@lo:104: 00010000:00010000:0.0:1789302463.118364:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900030800/0x20be524657f113ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f113a7 expref: 14 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.118374:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505162112:0@lo:104: 00000100:00100000:0.0:1789302463.118383:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505162240:0@lo:104: 00010000:00010000:0.0:1789302463.118392:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c9800/0x20be524657f1135a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f11353 expref: 13 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.118416:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1876219505162368:0@lo:104: 00010000:00010000:0.0:1789302463.118446:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302463.122279:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505162880 00010000:00010000:3.0:1789302463.122377:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1137d expref: 13 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302463.122442:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789302463.122455:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+13:3305:x1876219505162880:12345-0@lo:103: 00010000:00010000:3.0:1789302463.122474:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302463.122481:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1137d expref: 13 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122494:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1137d expref: 13 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122515:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba6600/0x20be524657f11384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1137d expref: 13 pid: 5840 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122541:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122552:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122574:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122582:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122609:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122617:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122624:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900030200 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302463.122629:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122639:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122664:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122677:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302463.122772:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505162880:12345-0@lo:103: Request processed in 319us (6196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.122780:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789302463.122824:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122833:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.122840:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900030200/0x20be524657f11409 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789302463.122877:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1789302463.123954:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302463.127896:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505162880:0@lo:103: 00000100:00100000:0.0:1789302463.184224:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+11:7636:x1876219505161728:12345-0@lo:253: Request processed in 114758us (114961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302463.184243:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789302463.184840:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505161728:0@lo:253: 10000000:01000000:3.0:1789302463.184863:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789302463.184867:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789302463.184870:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789302463.184871:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302463.184873:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789302463.184875:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302463.184876:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302463.184878:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302463.184880:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789302463.184882:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302463.184884:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789302463.184919:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6936077800 from lustre-OST0001 10000000:01000000:3.0:1789302463.184959:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789302463.184964:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789302463.184988:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a690a593380 local copy 10000000:01000000:3.0:1789302463.184995:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789302463.185193:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.185210:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.185224:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302463.185250:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936218000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163136:0@lo:101: 00000100:00100000:0.0:1789302463.185615:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302463.185724:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302463.185775:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505163136 00000100:00100000:1.0:1789302463.185787:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505163136 00000100:00100000:1.0:1789302463.185885:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789302463.185896:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+11:7636:x1876219505163136:12345-0@lo:101: 00010000:00010000:1.0:1789302463.185914:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302463.185933:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c9c00/0x20be524657f11417 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11410 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.185965:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c9c00/0x20be524657f11417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11410 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.185987:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c9c00/0x20be524657f11417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11410 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.186028:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9c00, rc 0) 00000100:00100000:1.0:1789302463.186152:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163136:12345-0@lo:101: Request processed in 258us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.186160:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789302463.186501:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936218000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163136:0@lo:101: 00010000:00010000:2.0:1789302463.186521:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.186532:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302463.186684:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163264:0@lo:501: 00000100:00100000:2.0:1789302463.186722:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302463.186810:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302463.186880:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505163264 00000100:00100000:1.0:1789302463.186887:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505163264 00000100:00100000:1.0:1789302463.186928:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789302463.186935:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163264:12345-0@lo:501: 00000100:00100000:1.0:1789302463.187553:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163264:12345-0@lo:501: Request processed in 616us (828us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302463.187561:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302463.187663:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163264:0@lo:501: 10000000:01000000:2.0:1789302463.187680:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789302463.187710:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789302463.187718:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.187740:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.187747:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.187774:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789302463.187799:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6936077800 10000000:01000000:2.0:1789302463.187805:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789302463.187812:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789302463.187814:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302463.187820:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789302463.187823:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789302463.187849:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.187859:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.187868:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302463.187884:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163392:0@lo:101: 00000100:00100000:2.0:1789302463.187919:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302463.187952:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eabb40 going to sleep for 11 seconds 00010000:00010000:3.0:1789302463.188029:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302463.188038:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.188046:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302463.188057:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.188065:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302463.188073:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302463.188079:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302463.188101:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.188107:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302463.188144:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.188151:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba6600/0x20be524657f11410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x20be524657f11417 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.188167:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302463.188169:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302463.188171:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302463.188180:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302463.188191:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505163520:0@lo:103: 00000100:00100000:3.0:1789302463.188225:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.188259:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505163520 00000100:00100000:3.0:1789302463.188264:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505163520 00000100:00100000:3.0:1789302463.188346:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302463.188356:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+12:3304:x1876219505163520:12345-0@lo:103: 00010000:00010000:3.0:1789302463.188369:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302463.188403:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c9c00/0x20be524657f11417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11410 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.188422:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302463.188454:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+11:3304:x1876219505163520:12345-0@lo:103: Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.188460:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302463.188494:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505163520:0@lo:103: 00000100:00100000:1.0:1789302463.188741:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505163392 00000100:00100000:1.0:1789302463.188746:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505163392 00000100:00100000:1.0:1789302463.188783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789302463.188792:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+11:7636:x1876219505163392:12345-0@lo:101: 00010000:00010000:1.0:1789302463.188805:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302463.188820:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1141e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.188844:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1141e expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.188856:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1141e expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.188863:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9400, rc 0) 00000100:00100000:1.0:1789302463.188895:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163392:12345-0@lo:101: Request processed in 105us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.188910:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789302463.189078:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163392:0@lo:101: 00010000:00010000:2.0:1789302463.189095:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.189115:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302463.189272:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163648:0@lo:501: 00000100:00100000:2.0:1789302463.189331:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302463.189361:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eabb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302463.189475:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505163648 00000100:00100000:1.0:1789302463.189480:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505163648 00000100:00100000:1.0:1789302463.189513:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789302463.189521:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163648:12345-0@lo:501: 00000100:00100000:1.0:1789302463.189815:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163648:12345-0@lo:501: Request processed in 294us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.189822:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789302463.189993:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163648:0@lo:501: 00000100:00100000:0.0:1789302463.190244:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163776:0@lo:503: 00000100:00100000:0.0:1789302463.190379:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302463.190478:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302463.190565:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505163776 00000100:00100000:3.0:1789302463.190572:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505163776 00000100:00100000:3.0:1789302463.190614:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789302463.190623:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163776:12345-0@lo:503: 00000100:00100000:3.0:1789302463.190817:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163776:12345-0@lo:503: Request processed in 195us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.190825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789302463.190847:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163776:0@lo:503: 00000040:00080000:0.0:1789302463.191589:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789302463.191672:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163904:0@lo:502: 00000100:00100000:0.0:1789302463.191734:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302463.191835:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302463.191988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505163904 00000100:00100000:1.0:1789302463.191995:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505163904 00000100:00100000:1.0:1789302463.192337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789302463.192348:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163904:12345-0@lo:502: 00000100:00100000:1.0:1789302463.192596:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505163904:12345-0@lo:502: Request processed in 249us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.192603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302463.192692:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505163904:0@lo:502: 00000040:00080000:0.0:1789302463.193005:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789302463.193072:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789302463.193106:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789302463.193163:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789302463.193201:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789302463.193236:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789302463.193270:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164032:0@lo:502: 00000100:00100000:0.0:1789302463.193340:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302463.193942:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815540 going to sleep for 11 seconds 00000100:00100000:2.0:1789302463.194001:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505164032 00000100:00100000:2.0:1789302463.194009:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505164032 00000100:00100000:1.0:1789302463.194380:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789302463.194541:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505164032:12345-0@lo:502: 00000100:00100000:1.0:1789302463.194962:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505164032:12345-0@lo:502: Request processed in 572us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.194970:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789302463.195278:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164032:0@lo:502: 00000040:00080000:2.0:1789302463.195561:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789302463.195580:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789302463.200834:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789302463.200851:0:7643:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789302463.200861:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302463.200863:0:7643:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789302463.200869:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302463.200890:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a690a594d40) 00000020:00000080:3.0:1789302463.200923:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789302463.200930:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789302463.201115:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6936077800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789302463.201126:0:7643:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789302463.201210:0:7643:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x20be524657f11433 00010000:00010000:2.0:1789302463.207366:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789302463.207920:0:7643:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789302463.214586:0:7643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789302463.216996:0:7643:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789302463.224666:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789302463.225633:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789302463.229093:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789302463.229109:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302463.229118:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302463.229121:0:7643:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789302463.230103:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302463.230117:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302463.230119:0:7643:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789302463.230127:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789302463.230129:0:7643:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789302463.230615:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302463.230619:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302463.230621:0:7643:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789302463.230625:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789302463.241089:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789302463.241151:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789302463.241177:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.241195:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302463.241217:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6936077800 from 1 10000000:01000000:1.0:1789302463.241221:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302463.241271:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.241279:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.241311:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302463.241345:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164160:0@lo:101: 00000100:00100000:1.0:1789302463.242855:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.242923:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302463.244160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505164160 00000100:00100000:3.0:1789302463.244176:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505164160 00000100:00100000:3.0:1789302463.244248:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789302463.244261:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+12:7636:x1876219505164160:12345-0@lo:101: 00010000:00010000:3.0:1789302463.244328:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302463.244354:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1143a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.244557:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1143a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.244574:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1143a expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.244584:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6600, rc 0) 00000100:00100000:3.0:1789302463.245743:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164160:12345-0@lo:101: Request processed in 1478us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.245756:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789302463.251552:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164160:0@lo:101: 00010000:00010000:2.0:1789302463.251595:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.251611:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302463.252786:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164288:0@lo:501: 00000100:00100000:2.0:1789302463.252867:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302463.252919:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302463.253057:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505164288 00000100:00100000:0.0:1789302463.253066:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505164288 00000100:00100000:0.0:1789302463.255441:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789302463.255470:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164288:12345-0@lo:501: 00000100:00100000:0.0:1789302463.255896:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164288:12345-0@lo:501: Request processed in 438us (3027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302463.255905:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789302463.258153:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164288:0@lo:501: 00000100:00100000:2.0:1789302463.258260:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164416:0@lo:503: 00000100:00100000:2.0:1789302463.258373:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302463.259028:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab180 going to sleep for 11 seconds 00000100:00100000:1.0:1789302463.259195:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505164416 00000100:00100000:1.0:1789302463.259204:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505164416 00000100:00100000:1.0:1789302463.259260:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302463.259270:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164416:12345-0@lo:503: 00000100:00100000:1.0:1789302463.259992:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164416:12345-0@lo:503: Request processed in 706us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.260002:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302463.260080:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164416:0@lo:503: 00000040:00080000:1.0:1789302463.260827:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302463.260937:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164544:0@lo:502: 00000100:00100000:1.0:1789302463.261243:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.261811:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789302463.267380:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505164544 00000100:00100000:3.0:1789302463.267496:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505164544 00000100:00100000:0.0:1789302463.267624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789302463.267641:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164544:12345-0@lo:502: 00000100:00100000:0.0:1789302463.268047:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164544:12345-0@lo:502: Request processed in 411us (6803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302463.268057:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789302463.270152:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164544:0@lo:502: 00000040:00080000:1.0:1789302463.270590:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789302463.270662:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789302463.270716:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164672:0@lo:502: 00000100:00100000:1.0:1789302463.270806:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.270859:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302463.271043:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505164672 00000100:00100000:2.0:1789302463.271053:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505164672 00000100:00100000:2.0:1789302463.271108:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789302463.271119:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164672:12345-0@lo:502: 00000100:00100000:2.0:1789302463.271379:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164672:12345-0@lo:502: Request processed in 260us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302463.271398:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789302463.271626:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164672:0@lo:502: 00000040:00080000:1.0:1789302463.271751:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789302463.271765:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789302463.274243:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302463.274262:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302463.274265:0:7647:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789302463.274274:0:7647:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6936077800 00000020:00000080:0.0:1789302463.274278:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302463.274343:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302463.274347:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302463.274349:0:7647:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789302463.274352:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789302463.274819:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789302463.274857:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302463.274891:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.274907:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302463.274962:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789302463.274965:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6936077800 10000000:01000000:1.0:1789302463.274969:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6936077800 10000000:01000000:1.0:1789302463.274974:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789302463.274994:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6936077800 from 1 10000000:01000000:1.0:1789302463.274997:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789302463.275049:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.275058:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.275071:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302463.275120:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164800:0@lo:101: 00000100:00100000:1.0:1789302463.275220:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.275279:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302463.275416:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505164800 00000100:00100000:2.0:1789302463.275426:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505164800 00000100:00100000:2.0:1789302463.275475:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789302463.275487:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505164800:12345-0@lo:101: 00010000:00010000:2.0:1789302463.275505:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302463.275522:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11448 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.275553:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11448 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.275566:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11448 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.275576:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abfe00, rc 0) 00000100:00100000:2.0:1789302463.275627:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505164800:12345-0@lo:101: Request processed in 142us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302463.275634:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789302463.276165:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164800:0@lo:101: 00010000:00010000:1.0:1789302463.276186:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.276197:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302463.276376:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164928:0@lo:501: 00000100:00100000:1.0:1789302463.276575:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.276613:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302463.277665:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505164928 00000100:00100000:2.0:1789302463.277679:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505164928 00000100:00100000:2.0:1789302463.277748:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789302463.277759:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505164928:12345-0@lo:501: 00000100:00100000:2.0:1789302463.278187:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505164928:12345-0@lo:501: Request processed in 425us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302463.278198:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789302463.278924:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505164928:0@lo:501: 00000100:00100000:1.0:1789302463.279009:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505165056:0@lo:503: 00000100:00100000:1.0:1789302463.279081:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.279123:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302463.279189:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505165056 00000100:00100000:3.0:1789302463.279197:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505165056 00000100:00100000:3.0:1789302463.279249:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789302463.279259:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505165056:12345-0@lo:503: 00000100:00100000:3.0:1789302463.279740:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505165056:12345-0@lo:503: Request processed in 481us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.279749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789302463.280123:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505165056:0@lo:503: 00000040:00080000:0.0:1789302463.280529:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789302463.280614:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505165184:0@lo:502: 00000100:00100000:0.0:1789302463.280684:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302463.280733:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302463.281042:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505165184 00000100:00100000:2.0:1789302463.281049:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505165184 00000100:00100000:2.0:1789302463.281088:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789302463.281098:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505165184:12345-0@lo:502: 00000100:00100000:2.0:1789302463.281420:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505165184:12345-0@lo:502: Request processed in 322us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302463.281430:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789302463.282061:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505165184:0@lo:502: 00000040:00080000:0.0:1789302463.282576:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789302463.282639:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789302463.282871:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789302463.282939:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789302463.282990:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789302463.283054:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789302463.283092:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789302463.283121:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789302463.289326:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789302463.289422:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789302463.289459:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789302463.289515:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789302463.289552:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789302463.289586:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789302463.289679:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789302463.290001:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789302463.290040:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789302463.290094:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789302463.290132:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789302463.290168:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789302463.290220:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789302463.290255:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789302463.290471:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789302463.290530:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789302463.290604:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789302463.290641:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789302463.290897:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789302463.290933:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789302463.290964:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789302463.291032:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789302463.291069:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789302463.291127:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789302463.291283:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789302463.293057:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789302463.293098:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789302463.293183:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789302463.293225:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789302463.294826:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505165312:0@lo:502: 00000100:00100000:2.0:1789302463.294953:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302463.295025:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab240 going to sleep for 11 seconds 00000100:00100000:0.0:1789302463.295557:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505165312 00000100:00100000:0.0:1789302463.295570:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505165312 00000100:00100000:0.0:1789302463.295641:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789302463.295662:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505165312:12345-0@lo:502: 00000100:00100000:0.0:1789302463.296022:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505165312:12345-0@lo:502: Request processed in 361us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302463.296031:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789302463.296230:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505165312:0@lo:502: 00000040:00080000:3.0:1789302463.296427:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789302463.296445:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789302463.301202:0:7648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789302463.301237:0:7648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a693bb8cd40) 00000020:00000080:3.0:1789302463.301273:0:7648:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789302463.301666:0:7648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6936077800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789302463.301672:0:7648:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6936077800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789302463.301676:0:7648:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6936077800 3 00010000:00080000:3.0:1789302463.301728:0:7648:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a693d776000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.142@tcp at head 00010000:00010000:3.0:1789302463.306481:0:7648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789302463.306902:0:7648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789302463.306954:0:7648:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789302463.311923:0:7648:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x20be524657f1145d 00000100:00080000:3.0:1789302463.311949:0:7648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302463.311967:0:7648:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a693d776000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789302463.312039:0:7648:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a693621b800 x1876219505165440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302463.312076:0:7648:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789302463.312427:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505165568:0@lo:400: 00000100:00100000:1.0:1789302463.312516:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.312583:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505165696:0@lo:400: 00000100:00100000:1.0:1789302463.312615:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.312634:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302463.312639:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505165824:0@lo:400: 00000100:00100000:1.0:1789302463.312666:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302463.312720:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505165568 00000100:00100000:1.0:1789302463.312731:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505165568 00000100:00100000:1.0:1789302463.312788:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505165696 00000100:00100000:1.0:1789302463.312792:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505165696 00000100:00100000:1.0:1789302463.312827:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302463.312836:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505165568:12345-0@lo:400: 00000100:00100000:1.0:1789302463.312897:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505165568:12345-0@lo:400: Request processed in 61us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.312904:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302463.312926:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302463.312933:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505165696:12345-0@lo:400: 00000100:00100000:1.0:1789302463.312964:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505165696:12345-0@lo:400: Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.312970:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302463.313007:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505165824 00000100:00100000:1.0:1789302463.313010:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505165824 00000100:00100000:1.0:1789302463.313041:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302463.313049:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505165824:12345-0@lo:400: 00000100:00100000:1.0:1789302463.313081:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505165824:12345-0@lo:400: Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302463.313087:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789302463.313109:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302463.313114:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789302463.313153:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6903e34380 x1876219505165824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302463.313170:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505165824:0@lo:400: 00010000:00080000:1.0:1789302463.313182:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6903e35500 x1876219505165696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302463.313205:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505165696:0@lo:400: 00010000:00080000:1.0:1789302463.313240:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6903e34a80 x1876219505165568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302463.313250:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505165568:0@lo:400: 00000100:00100000:0.0:1789302463.314122:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876219505165440:0@lo:38: 00000040:00080000:3.0:1789302463.314489:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1789302463.314823:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.314995:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505165440 00000100:00100000:3.0:1789302463.315004:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505165440 00000100:00100000:3.0:1789302463.315045:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302463.315053:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505165440:12345-0@lo:38: 00010000:00080000:3.0:1789302463.315084:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1789302463.315124:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x20be524657f11464 00000004:00100000:3.0:1789302463.315149:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789302463.315187:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a6806f02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302463.315251:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876219505165440:12345-0@lo:38: Request processed in 197us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.315259:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789302463.315333:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a693621b800 x1876219505165440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789302463.315712:0:7650:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9a690328ce00 x1876219505165952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302463.315724:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806bab000 going to sleep for 0 seconds 00000020:01000000:2.0:1789302463.315746:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789302463.315780:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302463.315797:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302463.315810:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789302463.315863:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789302463.315866:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302463.315867:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302463.315869:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302463.315873:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302463.315874:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302463.315876:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302463.315877:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302463.315879:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302463.315880:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302463.315882:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302463.315886:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789302463.315889:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302463.315890:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302463.315891:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302463.315892:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302463.315893:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302463.315894:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302463.315895:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302463.315896:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789302463.315897:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789302463.315898:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302463.315899:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302463.315912:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789302463.315921:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505166080:0@lo:253: 00000100:00100000:2.0:1789302463.315973:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.316110:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789302463.316120:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789302463.316137:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789302463.316143:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789302463.316146:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a693d776000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789302463.316154:0:3302:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000074272944): req@ffff9a690328ce00 x1876219505165952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302463.316172:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876219505165440:0@lo:38: 00000100:00100000:3.0:1789302463.316228:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302463.316267:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505165952 00000100:00100000:3.0:1789302463.316272:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505165952 00000100:00100000:3.0:1789302463.316356:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302463.316364:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7650:x1876219505165952:12345-0@lo:901: 00000100:00080000:1.0:1789302463.316593:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302463.317940:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7650:x1876219505165952:12345-0@lo:901: Request processed in 1569us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.317953:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789302463.318057:0:7650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a690328ce00 x1876219505165952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789302479 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302463.318072:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7650:1876219505165952:0@lo:901: 00000100:00100000:2.0:1789302463.319338:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806babf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302463.320105:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505166080 00000100:00100000:3.0:1789302463.320117:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505166080 00000100:00100000:3.0:1789302463.323011:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789302463.323035:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:7636:x1876219505166080:12345-0@lo:253: 20000000:01000000:3.0:1789302463.323083:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789302463.323100:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789302463.377725:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789302463.377784:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789302463.380594:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789302463.380608:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789302463.380637:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.380660:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f113b5 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.380669:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.380724:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f113b5 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302463.380741:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f113b5 expref: 14 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.380759:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876219505166208:0@lo:104: 00000100:00100000:0.0:1789302463.380842:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302463.380899:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302463.380966:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505166208 00000100:00100000:3.0:1789302463.380987:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505166208 00000100:00100000:3.0:1789302463.381056:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789302463.381066:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:5861:x1876219505166208:12345-0@lo:104: 00010000:00010000:3.0:1789302463.381084:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381155:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302463.381162:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:5861:x1876219505166208:12345-0@lo:104: Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302463.381169:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789302463.381193:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302463.381199:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381207:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302463.381211:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381220:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302463.381229:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302463.381235:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302463.381264:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381271:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302463.381333:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381341:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f113b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f113bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381360:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302463.381363:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302463.381364:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302463.381551:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505166336:0@lo:103: 00000100:00100000:1.0:1789302463.381594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302463.381720:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876219505166208:0@lo:104: 00010000:00010000:0.0:1789302463.381744:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302463.381799:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505166336 00000100:00100000:3.0:1789302463.381804:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505166336 00010000:00010000:3.0:1789302463.381826:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f113b5 expref: 15 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302463.381857:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789302463.381863:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690bb73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+15:3303:x1876219505166336:12345-0@lo:103: 00010000:00010000:3.0:1789302463.381876:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302463.381882:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f113b5 expref: 15 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381892:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f113b5 expref: 15 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381908:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba6400/0x20be524657f113bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f113b5 expref: 15 pid: 5838 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381922:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381931:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789302463.381957:0:6712:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003502174s 00010000:00010000:3.0:1789302463.381962:0:6712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381970:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381988:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.381995:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.382001:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900030800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302463.382006:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.382013:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.386550:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.386550:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302463.386583:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302463.386593:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302463.386851:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690bb73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+14:3303:x1876219505166336:12345-0@lo:103: Request processed in 4980us (5249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302463.386865:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302463.386967:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505166336:0@lo:103: 00010000:00010000:1.0:1789302463.388563:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900030800/0x20be524657f1146b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302463.392773:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8df8e325-951a-4604-89fa-82b64ca867d0:7636:1876219505166080:0@lo:253: 10000000:01000000:0.0:1789302463.392798:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789302463.392822:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789302463.392824:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789302463.392826:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302463.392828:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302463.392829:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302463.392831:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302463.392832:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789302463.392834:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789302463.392836:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789302463.392837:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302463.392839:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789302463.392868:0:7636:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789302463.392949:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:7636:x1876219505166080:12345-0@lo:253: Request processed in 69553us (76604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302463.393040:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00080000:10000000:0.0:1789302463.406251:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789302463.406492:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789302463.406707:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789302463.406917:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789302463.415829:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789302463.418679:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789302463.423807:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789302463.572534:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789302463.709279:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789302463.709416:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789302463.709580:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789302463.709665:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789302463.709691:0:7636:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789302463.709728:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789302464.589719:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302465.621278:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302465.944427:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302465.944460:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505166464:0@lo:13: 00000100:00100000:2.0:1789302465.944557:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302465.944642:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505166464 00000100:00100000:2.0:1789302465.944651:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505166464 00000100:00100000:2.0:1789302465.944721:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302465.944731:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505166464:12345-0@lo:13: 00002000:00000024:2.0:1789302465.944778:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302465.944832:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505166464:12345-0@lo:13: Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302465.944839:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789302465.944939:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302465.944989:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328f800 x1876219505166464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302465.945083:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505166464:0@lo:13: 00010000:00010000:3.0:1789302466.638570:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302467.664636:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302468.503582:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505166720:0@lo:400: 00000100:00100000:1.0:1789302468.503618:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505166592:0@lo:400: 00000100:00100000:2.0:1789302468.503806:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505166976:0@lo:400: 00000100:00100000:3.0:1789302468.503883:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302468.503995:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505166720 00000100:00100000:3.0:1789302468.504005:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505166720 00000100:00100000:3.0:1789302468.504206:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789302468.504219:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505166720:12345-0@lo:400: 00000100:00100000:3.0:1789302468.504315:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505166720:12345-0@lo:400: Request processed in 99us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302468.504323:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789302468.504382:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936219880 x1876219505166720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302468.504400:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505166720:0@lo:400: 00000100:00100000:1.0:1789302468.507714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302468.507789:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505167104:0@lo:400: 00000100:00100000:1.0:1789302468.507862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302468.507897:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505167104 00000100:00100000:3.0:1789302468.507920:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505167104 00000100:00100000:3.0:1789302468.508002:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789302468.508021:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505167104:12345-0@lo:400: 00000100:00100000:3.0:1789302468.508118:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505167104:12345-0@lo:400: Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302468.508126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789302468.508194:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693621b100 x1876219505167104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302468.508209:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505167104:0@lo:400: 00000100:00100000:3.0:1789302468.508331:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505166592 00000100:00100000:3.0:1789302468.508336:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505166592 00000100:00100000:3.0:1789302468.508368:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789302468.508374:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:3305:x1876219505166592:12345-0@lo:400: 00000100:00100000:3.0:1789302468.508414:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:3305:x1876219505166592:12345-0@lo:400: Request processed in 40us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302468.508435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789302468.508479:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505166848:0@lo:400: 00000100:00100000:3.0:1789302468.508508:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302468.508550:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505166592:0@lo:400: 00000100:00100000:3.0:1789302468.508609:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505166848 00000100:00100000:3.0:1789302468.508613:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505166848 00000100:00100000:3.0:1789302468.508640:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302468.508659:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505166848:12345-0@lo:400: 00000100:00100000:3.0:1789302468.508696:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505166848:12345-0@lo:400: Request processed in 37us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302468.508701:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789302468.508730:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693621a300 x1876219505166848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302468.508742:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505166848:0@lo:400: 00000100:00100000:2.0:1789302468.508963:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302468.509164:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505166976 00000100:00100000:3.0:1789302468.509170:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505166976 00000100:00100000:3.0:1789302468.509205:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302468.509328:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505166976:12345-0@lo:400: 00000100:00100000:3.0:1789302468.509376:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505166976:12345-0@lo:400: Request processed in 164us (413us total) trans 0 rc 0/0 00010000:00080000:2.0:1789302468.509400:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936219f80 x1876219505166976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302468.509412:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505166976:0@lo:400: 00000100:00100000:3.0:1789302468.511192:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789302468.513339:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302468.513355:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302468.691593:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302469.710561:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302470.614395:0:7991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789302470.737386:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789302471.053491:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789302471.053503:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6902e2c800 from 30 10000000:01000000:0.0:1789302471.053511:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789302471.053554:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.053573:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302471.053597:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789302471.053615:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302471.053625:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505167232:0@lo:13: 00000100:00100000:0.0:1789302471.053631:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505167360:0@lo:101: 00000100:00100000:1.0:1789302471.062603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.062603:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.062690:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69091a5780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302471.067676:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505167360 00000100:00100000:2.0:1789302471.067700:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505167360 00000100:00100000:2.0:1789302471.067792:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789302471.067805:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505167360:12345-0@lo:101: 00010000:00010000:2.0:1789302471.067827:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302471.067852:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11472 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.067921:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11472 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.067961:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11472 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.067972:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abe600, rc 0) 00000100:00100000:2.0:1789302471.068103:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505167360:12345-0@lo:101: Request processed in 300us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302471.068114:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789302471.068168:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505167232 00000100:00100000:2.0:1789302471.068173:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505167232 00000100:00100000:2.0:1789302471.068226:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302471.068233:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505167232:12345-0@lo:13: 00002000:00000024:2.0:1789302471.068267:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302471.068346:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505167232:12345-0@lo:13: Request processed in 114us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302471.068353:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789302471.068403:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328ca80 x1876219505167232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789302471.068409:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302471.068425:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505167232:0@lo:13: 00000100:00100000:0.0:1789302471.071527:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505167360:0@lo:101: 00010000:00010000:0.0:1789302471.071570:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.071590:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302471.071709:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505167488:0@lo:501: 00000100:00100000:0.0:1789302471.071818:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.071885:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69091a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.076376:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505167488 00000100:00100000:3.0:1789302471.076397:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505167488 00000100:00100000:3.0:1789302471.076672:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789302471.076685:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505167488:12345-0@lo:501: 00000100:00100000:3.0:1789302471.080667:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505167488:12345-0@lo:501: Request processed in 3971us (8837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.080767:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789302471.084744:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505167488:0@lo:501: 00000100:00100000:2.0:1789302471.084840:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505167616:0@lo:503: 00000100:00100000:2.0:1789302471.092943:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.093023:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806bab000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.093116:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505167616 00000100:00100000:3.0:1789302471.093135:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505167616 00000100:00100000:3.0:1789302471.093220:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789302471.093699:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505167616:12345-0@lo:503: 00000100:00100000:3.0:1789302471.094510:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505167616:12345-0@lo:503: Request processed in 813us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.094521:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789302471.095247:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505167616:0@lo:503: 00000100:00100000:2.0:1789302471.097415:0:8013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8013:1876219505167744:0@lo:502: 00000100:00100000:2.0:1789302471.097533:0:8013:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.097588:0:8013:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806babc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.098364:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505167744 00000100:00100000:3.0:1789302471.098377:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505167744 00000100:00100000:3.0:1789302471.098444:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789302471.098455:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+14:8013:x1876219505167744:12345-0@lo:502: 00000100:00100000:2.0:1789302471.103175:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+14:8013:x1876219505167744:12345-0@lo:502: Request processed in 4696us (5617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302471.103194:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789302471.104867:0:8013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8013:1876219505167744:0@lo:502: 00000100:00100000:3.0:1789302471.105000:0:8013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8013:1876219505167872:0@lo:502: 00000100:00100000:3.0:1789302471.105085:0:8013:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302471.105145:0:8013:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690873b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302471.105382:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505167872 00000100:00100000:2.0:1789302471.105391:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505167872 00000100:00100000:2.0:1789302471.105449:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789302471.105459:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:8013:x1876219505167872:12345-0@lo:502: 00000100:00100000:2.0:1789302471.105737:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:8013:x1876219505167872:12345-0@lo:502: Request processed in 278us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302471.105744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789302471.108231:0:8013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8013:1876219505167872:0@lo:502: 00000040:00080000:3.0:1789302471.108346:0:8013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789302471.108733:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789302471.108759:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302471.108773:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.108797:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302471.108808:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789302471.108811:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789302471.108814:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789302471.108868:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.108876:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.108901:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302471.108935:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168000:0@lo:101: 00000100:00100000:2.0:1789302471.109029:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.109093:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806babe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.110123:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505168000 00000100:00100000:3.0:1789302471.110137:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505168000 00000100:00100000:3.0:1789302471.110208:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789302471.110221:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505168000:12345-0@lo:101: 00010000:00010000:3.0:1789302471.110239:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302471.110267:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11480 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.110317:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11480 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.110331:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11480 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.110341:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302471.110426:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505168000:12345-0@lo:101: Request processed in 207us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.110432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789302471.111376:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168000:0@lo:101: 00010000:00010000:2.0:1789302471.111406:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.111419:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302471.111505:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168128:0@lo:501: 00000100:00100000:2.0:1789302471.111561:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.111610:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806babe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.113453:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505168128 00000100:00100000:3.0:1789302471.113470:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505168128 00000100:00100000:3.0:1789302471.113556:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789302471.113568:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505168128:12345-0@lo:501: 00000100:00100000:3.0:1789302471.113955:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505168128:12345-0@lo:501: Request processed in 388us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.113964:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789302471.114261:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168128:0@lo:501: 00000100:00100000:2.0:1789302471.114349:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168256:0@lo:503: 00000100:00100000:2.0:1789302471.114399:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.114436:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806babe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.114775:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505168256 00000100:00100000:3.0:1789302471.114789:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505168256 00000100:00100000:3.0:1789302471.114829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789302471.114838:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505168256:12345-0@lo:503: 00000100:00100000:3.0:1789302471.115221:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505168256:12345-0@lo:503: Request processed in 382us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.115230:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789302471.116392:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168256:0@lo:503: 00000100:00100000:2.0:1789302471.116823:0:8014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8014:1876219505168384:0@lo:502: 00000100:00100000:2.0:1789302471.116898:0:8014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.116954:0:8014:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806babc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.116998:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505168384 00000100:00100000:3.0:1789302471.117005:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505168384 00000100:00100000:3.0:1789302471.117064:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789302471.117081:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:8014:x1876219505168384:12345-0@lo:502: 00000100:00100000:3.0:1789302471.117402:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:8014:x1876219505168384:12345-0@lo:502: Request processed in 328us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.117410:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789302471.117690:0:8014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8014:1876219505168384:0@lo:502: 00000020:01000000:2.0:1789302471.117732:0:8014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302471.117745:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302471.117748:0:8014:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789302471.117753:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789302471.117755:0:8014:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789302471.117786:0:8014:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8014:1876219505168512:0@lo:502: 00000100:00100000:2.0:1789302471.117822:0:8014:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.117847:0:8014:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6806babc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.119903:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505168512 00000100:00100000:3.0:1789302471.119931:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505168512 00000100:00100000:3.0:1789302471.119996:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789302471.120008:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:8014:x1876219505168512:12345-0@lo:502: 00000100:00100000:3.0:1789302471.120494:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:8014:x1876219505168512:12345-0@lo:502: Request processed in 486us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.120855:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789302471.121011:0:8014:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8014:1876219505168512:0@lo:502: 00000020:01000000:2.0:1789302471.121058:0:8014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302471.121067:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302471.121069:0:8014:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789302471.121086:0:8014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789302471.121735:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789302471.121760:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789302471.121774:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.122318:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302471.122337:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789302471.122341:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6905909800 from 30 10000000:01000000:3.0:1789302471.122345:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789302471.122404:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.122414:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.122447:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302471.122474:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168640:0@lo:101: 00000100:00100000:3.0:1789302471.124795:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302471.124853:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302471.126040:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505168640 00000100:00100000:2.0:1789302471.126059:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505168640 00000100:00100000:2.0:1789302471.129807:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789302471.129823:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505168640:12345-0@lo:101: 00010000:00010000:2.0:1789302471.129846:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302471.129871:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1148e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.129909:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1148e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.129932:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1148e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302471.129943:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abe000, rc 0) 00000100:00100000:2.0:1789302471.130053:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505168640:12345-0@lo:101: Request processed in 234us (5280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302471.130088:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789302471.130455:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168640:0@lo:101: 00010000:00010000:1.0:1789302471.130480:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302471.130492:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302471.130582:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168768:0@lo:501: 00000100:00100000:1.0:1789302471.130624:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.130658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505168768 00000100:00100000:1.0:1789302471.130664:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505168768 00000100:00100000:1.0:1789302471.130697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789302471.130704:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505168768:12345-0@lo:501: 00000100:00100000:1.0:1789302471.131033:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505168768:12345-0@lo:501: Request processed in 328us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302471.131040:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789302471.132335:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805815f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302471.132392:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168768:0@lo:501: 00000100:00100000:1.0:1789302471.132464:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168896:0@lo:503: 00000100:00100000:1.0:1789302471.132560:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.132616:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505168896 00000100:00100000:1.0:1789302471.132624:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505168896 00000100:00100000:1.0:1789302471.132671:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789302471.132681:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505168896:12345-0@lo:503: 00000100:00100000:1.0:1789302471.132902:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505168896:12345-0@lo:503: Request processed in 221us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302471.132909:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789302471.132969:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302471.132981:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505168896:0@lo:503: 00000100:00100000:1.0:1789302471.134481:0:8015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8015:1876219505169024:0@lo:502: 00000100:00100000:1.0:1789302471.134573:0:8015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.134603:0:8015:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.135524:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505169024 00000100:00100000:3.0:1789302471.135537:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505169024 00000100:00100000:3.0:1789302471.135602:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789302471.135612:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:8015:x1876219505169024:12345-0@lo:502: 00000100:00100000:3.0:1789302471.135919:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:8015:x1876219505169024:12345-0@lo:502: Request processed in 307us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.135938:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789302471.136147:0:8015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8015:1876219505169024:0@lo:502: 00000100:00100000:1.0:1789302471.136496:0:8015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8015:1876219505169152:0@lo:502: 00000100:00100000:1.0:1789302471.136546:0:8015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.136580:0:8015:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.137376:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505169152 00000100:00100000:3.0:1789302471.137388:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505169152 00000100:00100000:3.0:1789302471.137436:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789302471.137444:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:8015:x1876219505169152:12345-0@lo:502: 00000100:00100000:3.0:1789302471.137709:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:8015:x1876219505169152:12345-0@lo:502: Request processed in 265us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.137717:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789302471.139395:0:8015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8015:1876219505169152:0@lo:502: 00000040:00080000:0.0:1789302471.139449:0:8015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789302471.141212:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789302471.141256:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789302471.141270:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.141302:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302471.141326:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789302471.141330:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6905909800 from 5 10000000:01000000:3.0:1789302471.141333:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789302471.141392:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.141401:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.141413:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302471.141440:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936218700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169280:0@lo:101: 00000100:00100000:3.0:1789302471.141517:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302471.141569:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.141595:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505169280 00000100:00100000:3.0:1789302471.141603:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505169280 00000100:00100000:3.0:1789302471.141649:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789302471.141659:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505169280:12345-0@lo:101: 00010000:00010000:3.0:1789302471.141674:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302471.141689:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba7e00/0x20be524657f114a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1149c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.141716:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7e00/0x20be524657f114a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1149c expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.141727:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba7e00/0x20be524657f114a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1149c expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.141747:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7e00, rc 0) 00000100:00100000:3.0:1789302471.142232:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505169280:12345-0@lo:101: Request processed in 572us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.142240:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789302471.142321:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936218700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169280:0@lo:101: 00010000:00010000:3.0:1789302471.142338:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.142349:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302471.142904:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936218700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169408:0@lo:256: 00000100:00100000:3.0:1789302471.142965:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302471.142996:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.143019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505169408 00000100:00100000:3.0:1789302471.143025:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505169408 00000100:00100000:3.0:1789302471.143058:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789302471.143066:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505169408:12345-0@lo:256: 20000000:01000000:3.0:1789302471.144447:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789302471.144479:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789302471.144483:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789302471.144975:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505169408:12345-0@lo:256: Request processed in 1903us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.144987:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789302471.145477:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936218700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169408:0@lo:256: 10000000:01000000:0.0:1789302471.145547:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789302471.145560:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.145574:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302471.145599:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789302471.145602:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789302471.145605:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789302471.145642:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.145651:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.145661:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302471.145681:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169536:0@lo:101: 00000100:00100000:0.0:1789302471.145721:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.145761:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69091a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.146947:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505169536 00000100:00100000:3.0:1789302471.146965:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505169536 00000100:00100000:3.0:1789302471.147049:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789302471.147061:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505169536:12345-0@lo:101: 00010000:00010000:3.0:1789302471.147426:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302471.147449:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f114aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.147483:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f114aa expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.147495:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f114aa expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302471.147506:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7a00, rc 0) 00000100:00100000:3.0:1789302471.147588:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505169536:12345-0@lo:101: Request processed in 529us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.147596:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789302471.148197:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169536:0@lo:101: 00010000:00010000:0.0:1789302471.148223:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.148234:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302471.148354:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169664:0@lo:501: 00000100:00100000:0.0:1789302471.148407:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.148443:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69091a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.148656:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505169664 00000100:00100000:3.0:1789302471.148664:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505169664 00000100:00100000:3.0:1789302471.148704:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789302471.148712:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505169664:12345-0@lo:501: 00000100:00100000:3.0:1789302471.151426:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505169664:12345-0@lo:501: Request processed in 2700us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.151443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789302471.151703:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169664:0@lo:501: 00000100:00100000:0.0:1789302471.151770:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169792:0@lo:503: 00000100:00100000:0.0:1789302471.151848:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.151893:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69091a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.151989:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505169792 00000100:00100000:3.0:1789302471.151997:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505169792 00000100:00100000:3.0:1789302471.152045:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789302471.152055:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505169792:12345-0@lo:503: 00000100:00100000:3.0:1789302471.152449:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505169792:12345-0@lo:503: Request processed in 395us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.152463:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789302471.152952:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505169792:0@lo:503: 00000100:00100000:1.0:1789302471.153261:0:8016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8016:1876219505169920:0@lo:502: 00000100:00100000:1.0:1789302471.153332:0:8016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.153351:0:8016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302471.153523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505169920 00000100:00100000:0.0:1789302471.153531:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505169920 00000100:00100000:0.0:1789302471.153577:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789302471.153586:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:8016:x1876219505169920:12345-0@lo:502: 00000100:00100000:0.0:1789302471.153907:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:8016:x1876219505169920:12345-0@lo:502: Request processed in 322us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302471.153915:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789302471.154158:0:8016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8016:1876219505169920:0@lo:502: 00000020:01000000:1.0:1789302471.154200:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789302471.154211:0:8016:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789302471.154219:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302471.154222:0:8016:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789302471.154232:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789302471.154237:0:8016:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:1.0:1789302471.154267:0:8016:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789302471.154270:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302471.154342:0:8016:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a690a4199c0) 00000020:00000080:1.0:1789302471.154573:0:8016:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789302471.154584:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789302471.154684:0:8016:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789302471.154691:0:8016:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789302471.154699:0:8016:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f114bf 00010000:00080000:1.0:1789302471.154749:0:8016:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69369e9800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:1.0:1789302471.155518:0:8016:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789302471.156597:0:8016:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789302471.156617:0:8016:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789302471.166900:0:8016:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302471.167266:0:8016:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302471.171353:0:8016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789302471.171473:0:8016:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789302471.172997:0:8018:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302471.173005:0:8018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789302471.174041:0:8016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789302471.174055:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789302471.174095:0:8016:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789302471.174124:0:8016:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f114c6 00000100:00080000:1.0:1789302471.174138:0:8016:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302471.174154:0:8016:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69369e9800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789302471.174200:0:8016:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6903e37100 x1876219505170048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302471.174229:0:8016:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789302471.174275:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505170048:0@lo:8: 00000020:01000000:1.0:1789302471.174336:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302471.174357:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302471.174360:0:8016:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789302471.174364:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302471.174368:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302471.174370:0:8016:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789302471.174372:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789302471.174374:0:8016:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789302471.174389:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.174413:0:8016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8016:1876219505170176:0@lo:502: 00000100:00100000:3.0:1789302471.174459:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505170048 00000100:00100000:1.0:1789302471.174461:0:8016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302471.174467:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505170048 00000100:00100000:1.0:1789302471.174476:0:8016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.174503:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302471.174513:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1876219505170048:12345-0@lo:8: 00010000:00080000:3.0:1789302471.174544:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:3.0:1789302471.174574:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f114cd 00002000:00100000:3.0:1789302471.174588:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a6806f03800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789302471.174592:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789302471.174598:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789302471.174740:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789302471.174950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505170176 00000100:00100000:0.0:1789302471.174956:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505170176 00000100:00100000:0.0:1789302471.175005:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789302471.175013:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:8016:x1876219505170176:12345-0@lo:502: 00000100:00100000:0.0:1789302471.175317:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:8016:x1876219505170176:12345-0@lo:502: Request processed in 304us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302471.175326:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789302471.175423:0:8016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8016:1876219505170176:0@lo:502: 00000020:01000000:1.0:1789302471.175456:0:8016:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302471.175461:0:8016:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302471.175463:0:8016:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789302471.175466:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789302471.175528:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789302471.175545:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789302471.175557:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302471.175569:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302471.175580:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789302471.175584:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a690a593380 from 1 10000000:01000000:1.0:1789302471.175587:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789302471.175614:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302471.175623:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302471.175634:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302471.175651:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505170304:0@lo:101: 00000100:00100000:1.0:1789302471.175681:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.175724:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302471.175953:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505170304 00000100:00100000:0.0:1789302471.175960:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505170304 00000100:00100000:0.0:1789302471.176001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789302471.176009:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505170304:12345-0@lo:101: 00010000:00010000:0.0:1789302471.176021:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302471.176037:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f114d4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.176062:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f114d4 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.176073:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f114d4 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.176090:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6900031a00, rc 0) 00000100:00100000:0.0:1789302471.176124:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505170304:12345-0@lo:101: Request processed in 115us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302471.176130:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789302471.176177:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505170304:0@lo:101: 00000100:00100000:2.0:1789302471.176393:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505170560:0@lo:400: 00000100:00100000:2.0:1789302471.176443:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.176470:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302471.176476:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505170432:0@lo:400: 00000100:00100000:2.0:1789302471.176503:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302471.176529:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505170688:0@lo:400: 00000100:00100000:2.0:1789302471.176576:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302471.177639:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.177656:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302471.177743:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505170816:0@lo:501: 00002000:00080000:3.0:1789302471.177980:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789302471.178021:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9a6806f06800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302471.178554:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876219505170048:12345-0@lo:8: Request processed in 4036us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.178566:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302471.178626:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505170560 00000100:00100000:3.0:1789302471.178633:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505170560 00000100:00100000:3.0:1789302471.178683:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505170432 00000100:00100000:3.0:1789302471.178686:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505170432 00000100:00100000:3.0:1789302471.178698:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505170688 00000100:00100000:3.0:1789302471.178700:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505170688 00000100:00100000:3.0:1789302471.178715:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302471.178724:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505170560:12345-0@lo:400: 00000100:00100000:3.0:1789302471.178771:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505170560:12345-0@lo:400: Request processed in 49us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302471.178943:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789302471.179127:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903e37100 x1876219505170048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302471.179140:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302471.179151:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789302471.179160:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789302471.179166:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789302471.179170:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69369e9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789302471.179185:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789302471.179256:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505170048:0@lo:8: 00000004:00080000:2.0:1789302471.179299:0:8018:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789302471.179456:0:8018:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 182365169710ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789302471.179538:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302471.179557:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505170816 00000100:00100000:0.0:1789302471.179563:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505170816 00000100:00100000:0.0:1789302471.179603:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789302471.179611:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505170816:12345-0@lo:501: 00000100:00100000:3.0:1789302471.179937:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302471.179961:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302471.180034:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505170432:12345-0@lo:400: 00000100:00100000:2.0:1789302471.180347:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302471.180360:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505170688:12345-0@lo:400: 00000100:00100000:2.0:1789302471.180405:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505170688:12345-0@lo:400: Request processed in 49us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302471.180422:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789302471.180469:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328ce00 x1876219505170688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302471.180484:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505170688:0@lo:400: 00000100:00100000:3.0:1789302471.180865:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505170432:12345-0@lo:400: Request processed in 156us (3688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302471.180874:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789302471.180955:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328ca80 x1876219505170432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302471.180976:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505170432:0@lo:400: 00010000:00080000:3.0:1789302471.180992:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328c000 x1876219505170560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302471.181000:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505170560:0@lo:400: 00000100:00100000:0.0:1789302471.181992:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505170816:12345-0@lo:501: Request processed in 2374us (3041us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302471.182005:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789302471.182082:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505170816:0@lo:501: 10000000:01000000:0.0:1789302471.182127:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789302471.182140:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302471.182173:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789302471.182425:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789302471.310364:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789302471.351197:0:8019:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789302471.351245:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8019:1876219505171072:0@lo:7: 00000100:00100000:0.0:1789302471.351376:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.351447:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906186900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302471.351466:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302471.351481:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505170944:0@lo:13: 00000100:00100000:0.0:1789302471.351509:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.351547:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505171072 00000100:00100000:0.0:1789302471.351558:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505171072 00000100:00100000:0.0:1789302471.351634:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302471.351646:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8019:x1876219505171072:12345-0@lo:7: 00000100:00100000:1.0:1789302471.353424:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505170944 00000100:00100000:1.0:1789302471.353438:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505170944 00000100:00100000:1.0:1789302471.353492:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789302471.353502:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505170944:12345-0@lo:13: 00002000:00000024:1.0:1789302471.353545:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789302471.353640:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505170944:12345-0@lo:13: Request processed in 140us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302471.353648:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789302471.362352:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789302471.362457:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6935d1b800 x1876219505170944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302471.362492:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505170944:0@lo:13: 00002000:00080000:0.0:1789302471.374820:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789302471.374832:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789302471.375084:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8019:x1876219505171072:12345-0@lo:7: Request processed in 23434us (23701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302471.375099:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789302471.378885:0:8019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6935d1aa00 x1876219505171072/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789302487 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302471.378906:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8019:1876219505171072:0@lo:7: 00000004:00080000:1.0:1789302471.378937:0:8019:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789302471.385190:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8019:1876219505171200:0@lo:5: 00000100:00100000:0.0:1789302471.385318:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.385396:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302471.385630:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505171200 00000100:00100000:3.0:1789302471.385641:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505171200 00000100:00100000:3.0:1789302471.385730:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789302471.385741:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8019:x1876219505171200:12345-0@lo:5: 00002000:00080000:3.0:1789302471.385778:0:6696:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789302471.385783:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789302471.386265:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8019:x1876219505171200:12345-0@lo:5: Request processed in 525us (946us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789302471.386274:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789302471.387438:0:8019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6935d1b800 x1876219505171200/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302487 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302471.387462:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8019:1876219505171200:0@lo:5: 00000004:00080000:0.0:1789302471.387478:0:8019:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789302471.387520:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8019:1876219505171328:0@lo:700: 00000100:00100000:0.0:1789302471.387568:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302471.387605:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302471.387661:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505171328 00000100:00100000:1.0:1789302471.387669:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505171328 00000100:00100000:1.0:1789302471.387727:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302471.387736:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8019:x1876219505171328:12345-0@lo:700: 00000100:00100000:1.0:1789302471.387772:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1876219505171456:0@lo:700: 00000100:00100000:1.0:1789302471.387803:0:6705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.387820:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302471.387834:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505171456 00000100:00100000:1.0:1789302471.387837:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505171456 00000100:00100000:1.0:1789302471.387863:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302471.387869:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1876219505171456:12345-0@lo:700: 40000000:02000000:1.0:1789302471.457081:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789302471.466269:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1876219505171456:12345-0@lo:700: Request processed in 78387us (78452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302471.466337:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789302471.466854:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903e34700 x1876219505171456/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789302487 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302471.466874:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1876219505171456:0@lo:700: 40000000:02000000:2.0:1789302471.466893:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1789302471.580415:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8019:x1876219505171328:12345-0@lo:700: Request processed in 192669us (192835us total) trans 0 rc 0/0 00010000:00080000:0.0:1789302471.580435:0:8019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6935d1ad80 x1876219505171328/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789302487 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302471.580437:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302471.580455:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8019:1876219505171328:0@lo:700: 00000001:00080000:3.0:1789302471.580497:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789302471.580513:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1789302471.645226:0:8019:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789302471.656131:0:8019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8019:1876219505171584:0@lo:5: 00000100:00100000:1.0:1789302471.656233:0:8019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302471.656330:0:8019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302471.656357:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505171584 00000100:00100000:0.0:1789302471.656370:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505171584 00000100:00100000:0.0:1789302471.656458:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302471.656471:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8019:x1876219505171584:12345-0@lo:5: 00002000:00080000:1.0:1789302471.685308:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789302471.685355:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789302471.709385:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8019:x1876219505171584:12345-0@lo:5: Request processed in 52902us (53137us total) trans 4294967298 rc 0/0 00010000:00080000:0.0:1789302471.709524:0:8019:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903e34700 x1876219505171584/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302487 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302471.709545:0:8019:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789302471.709596:0:8019:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6903e34700 x1876219505171584/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789302487 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302471.709621:0:8019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8019:1876219505171584:0@lo:5: 00000004:00080000:0.0:1789302471.709656:0:8019:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789302471.711050:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789302471.758664:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302472.781453:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302473.805624:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302474.833817:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302475.853607:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789302476.095157:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1789302476.173666:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505171712:0@lo:13: 00000100:00100000:3.0:1789302476.173754:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302476.175029:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505171712 00000100:00100000:2.0:1789302476.175044:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505171712 00000100:00100000:2.0:1789302476.175121:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302476.175133:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505171712:12345-0@lo:13: 00002000:00000024:2.0:1789302476.175178:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302476.175259:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505171712:12345-0@lo:13: Request processed in 129us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302476.175266:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789302476.175317:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302476.175365:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328ce00 x1876219505171712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302476.175386:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505171712:0@lo:13: 00000100:00100000:3.0:1789302476.499642:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302476.500084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484176512 00000100:00100000:0.0:1789302476.500099:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484176512 00000100:00100000:0.0:1789302476.500153:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 112 00000100:00100000:0.0:1789302476.500164:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2350:x1876219484176512:12345-192.168.203.42@tcp:250: 00010000:00080000:0.0:1789302476.500212:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from fa0c5b74-f3e3-435b-a0ad-f716a60f5a86@192.168.203.42@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:0.0:1789302476.500248:0:5838:0:(genops.c:1384:class_connect()) connect: client fa0c5b74-f3e3-435b-a0ad-f716a60f5a86, cookie 0x20be524657f114e2 00000100:00080000:0.0:1789302476.500462:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9a6805806800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302476.500555:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+5:2350:x1876219484176512:12345-192.168.203.42@tcp:250: Request processed in 390us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302476.500563:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 112 00000100:00100000:0.0:1789302476.507844:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302476.510184:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484176640 00000100:00100000:1.0:1789302476.510208:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484176640 00000100:00100000:1.0:1789302476.510305:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:1.0:1789302476.510319:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+5:5579:x1876219484176640:12345-192.168.203.42@tcp:101: 00010000:00010000:1.0:1789302476.510344:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302476.510370:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3525 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302476.510407:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302476.510431:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302476.510441:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9800, rc 0) 00000100:00100000:1.0:1789302476.510523:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+6:5579:x1876219484176640:12345-192.168.203.42@tcp:101: Request processed in 207us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302476.510531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:1.0:1789302476.514805:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302476.515039:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484176768 00000100:00100000:3.0:1789302476.515053:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484176768 00000100:00100000:3.0:1789302476.515118:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:3.0:1789302476.515130:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+6:5579:x1876219484176768:12345-192.168.203.42@tcp:501: 00000100:00100000:3.0:1789302476.515476:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+6:5579:x1876219484176768:12345-192.168.203.42@tcp:501: Request processed in 347us (694us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302476.515486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:3.0:1789302476.518399:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302476.520635:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484176896 00000100:00100000:2.0:1789302476.520655:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484176896 00000100:00100000:2.0:1789302476.520741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:2.0:1789302476.520754:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+6:5579:x1876219484176896:12345-192.168.203.42@tcp:101: 00010000:00010000:2.0:1789302476.520803:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302476.520830:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b352c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302476.520870:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302476.520883:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302476.520903:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abf000, rc 0) 00000100:00100000:2.0:1789302476.520999:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+7:5579:x1876219484176896:12345-192.168.203.42@tcp:101: Request processed in 248us (2612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302476.521006:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:3.0:1789302476.531625:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302476.532397:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484177024 00000100:00100000:1.0:1789302476.532413:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484177024 00000100:00100000:1.0:1789302476.532501:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:1.0:1789302476.532515:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+7:5579:x1876219484177024:12345-192.168.203.42@tcp:501: 00000100:00100000:1.0:1789302476.533086:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5579:x1876219484177024:12345-192.168.203.42@tcp:501: Request processed in 570us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302476.533096:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:1.0:1789302476.535216:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302476.535344:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484177152 00000100:00100000:3.0:1789302476.535357:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484177152 00000100:00100000:3.0:1789302476.535413:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:3.0:1789302476.535544:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5579:x1876219484177152:12345-192.168.203.42@tcp:503: 00000100:00100000:3.0:1789302476.536211:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5579:x1876219484177152:12345-192.168.203.42@tcp:503: Request processed in 669us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302476.536221:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:0.0:1789302476.557949:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302476.558048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484177280 00000100:00100000:3.0:1789302476.558064:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484177280 00000100:00100000:3.0:1789302476.558138:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:3.0:1789302476.558150:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5598:x1876219484177280:12345-192.168.203.42@tcp:502: 00000100:00100000:3.0:1789302476.558816:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5598:x1876219484177280:12345-192.168.203.42@tcp:502: Request processed in 665us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302476.558825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:1.0:1789302476.596171:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302476.601216:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484177408 00000100:00100000:2.0:1789302476.601238:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484177408 00000100:00100000:2.0:1789302476.601340:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:2.0:1789302476.601353:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5598:x1876219484177408:12345-192.168.203.42@tcp:502: 00000100:00100000:2.0:1789302476.601742:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5598:x1876219484177408:12345-192.168.203.42@tcp:502: Request processed in 390us (5585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302476.601751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:1.0:1789302476.613156:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302476.613244:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484177536 00000100:00100000:0.0:1789302476.613257:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484177536 00000100:00100000:0.0:1789302476.613357:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:0.0:1789302476.613372:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5579:x1876219484177536:12345-192.168.203.42@tcp:101: 00010000:00010000:0.0:1789302476.613395:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302476.613674:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6900031800/0x20be524657f114f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3556 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302476.613858:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900031800/0x20be524657f114f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3556 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302476.613876:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6900031800/0x20be524657f114f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3556 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302476.613898:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6900031800, rc 0) 00000100:00100000:1.0:1789302476.614094:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5579:x1876219484177536:12345-192.168.203.42@tcp:101: Request processed in 726us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302476.614103:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:2.0:1789302476.616276:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302476.616338:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484177664 00000100:00100000:0.0:1789302476.616350:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484177664 00000100:00100000:0.0:1789302476.616416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:0.0:1789302476.616427:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5579:x1876219484177664:12345-192.168.203.42@tcp:256: 20000000:01000000:0.0:1789302476.616457:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789302476.616494:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789302476.616498:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789302476.616502:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789302476.616504:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789302476.620482:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5579:x1876219484177664:12345-192.168.203.42@tcp:256: Request processed in 4041us (4202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302476.620502:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:0.0:1789302476.630283:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302476.630418:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484177792 00000100:00100000:2.0:1789302476.630432:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484177792 00000100:00100000:2.0:1789302476.631630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:2.0:1789302476.631650:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5579:x1876219484177792:12345-192.168.203.42@tcp:101: 00010000:00010000:2.0:1789302476.631673:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302476.631711:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b355d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302476.631748:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302476.631763:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302476.632686:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abfc00, rc 0) 00000100:00100000:2.0:1789302476.632774:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5579:x1876219484177792:12345-192.168.203.42@tcp:101: Request processed in 1129us (2504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302476.632783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:2.0:1789302476.638629:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302476.638677:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484177920 00000100:00100000:2.0:1789302476.638688:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484177920 00000100:00100000:2.0:1789302476.638749:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:2.0:1789302476.638760:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5579:x1876219484177920:12345-192.168.203.42@tcp:501: 00000100:00100000:2.0:1789302476.640125:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5579:x1876219484177920:12345-192.168.203.42@tcp:501: Request processed in 1356us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302476.640138:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:1.0:1789302476.651021:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302476.651243:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484178048 00000100:00100000:3.0:1789302476.651257:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484178048 00000100:00100000:3.0:1789302476.651342:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00100000:3.0:1789302476.651354:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5579:x1876219484178048:12345-192.168.203.42@tcp:503: 00000100:00100000:3.0:1789302476.652694:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5579:x1876219484178048:12345-192.168.203.42@tcp:503: Request processed in 1332us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302476.652708:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00100000:2.0:1789302476.672348:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302476.677357:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484178176 00000100:00100000:0.0:1789302476.677382:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484178176 00000100:00100000:0.0:1789302476.677681:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00100000:0.0:1789302476.677694:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5604:x1876219484178176:12345-192.168.203.42@tcp:502: 00000100:00100000:0.0:1789302476.678267:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5604:x1876219484178176:12345-192.168.203.42@tcp:502: Request processed in 574us (5932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302476.678276:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00100000:3.0:1789302476.681558:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302476.681680:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484178304 00000100:00100000:2.0:1789302476.681694:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484178304 00000100:00100000:2.0:1789302476.681759:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 126 00000100:00100000:2.0:1789302476.681773:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5604:x1876219484178304:12345-192.168.203.42@tcp:502: 00000100:00100000:2.0:1789302476.682073:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5604:x1876219484178304:12345-192.168.203.42@tcp:502: Request processed in 302us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302476.682093:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 126 00000100:00100000:3.0:1789302476.687319:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505171840:0@lo:400: 00000100:00100000:3.0:1789302476.687415:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302476.687470:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505172352:0@lo:400: 00000100:00100000:3.0:1789302476.687667:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302476.687701:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302476.687708:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505172224:0@lo:400: 00000100:00100000:3.0:1789302476.687743:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302476.687778:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505171968:0@lo:400: 00000100:00100000:3.0:1789302476.687851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302476.687874:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302476.687881:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505172096:0@lo:400: 00000100:00100000:3.0:1789302476.687920:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302476.688882:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505171840 00000100:00100000:3.0:1789302476.688904:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505171840 00000100:00100000:3.0:1789302476.689353:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302476.689390:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505172352 00000100:00100000:3.0:1789302476.689396:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505172352 00000100:00100000:3.0:1789302476.689465:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302476.689476:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505172352:12345-0@lo:400: 00000100:00100000:3.0:1789302476.689552:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505172352:12345-0@lo:400: Request processed in 78us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302476.689559:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302476.689585:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505172224 00000100:00100000:3.0:1789302476.689589:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505172224 00010000:00080000:2.0:1789302476.691066:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693621b480 x1876219505172352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302476.691085:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789302476.691106:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505172352:0@lo:400: 00000100:00080000:0.0:1789302476.691269:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302476.691277:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302476.691315:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505171968 00000100:00100000:0.0:1789302476.691323:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505171968 00000100:00100000:3.0:1789302476.691331:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505172096 00000100:00100000:3.0:1789302476.691339:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505172096 00000100:00100000:0.0:1789302476.691367:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484178432 00000100:00100000:0.0:1789302476.691372:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484178432 00000100:00100000:3.0:1789302476.691383:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302476.691395:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505172224:12345-0@lo:400: 00000100:00100000:3.0:1789302476.691482:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505172224:12345-0@lo:400: Request processed in 90us (3738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302476.692212:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302476.692224:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505171968:12345-0@lo:400: 00000100:00100000:3.0:1789302476.692229:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789302476.692254:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789302476.692263:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505172096:12345-0@lo:400: 00000100:00100000:0.0:1789302476.692314:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505171968:12345-0@lo:400: Request processed in 93us (4461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302476.692322:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789302476.692327:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505172096:12345-0@lo:400: Request processed in 64us (4403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302476.692335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789302476.692349:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:0.0:1789302476.692356:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1876219484178432:12345-192.168.203.42@tcp:38: 00000100:00100000:3.0:1789302476.692365:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302476.692386:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505172480:0@lo:13: 00010000:00080000:0.0:1789302476.692397:0:6295:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp t0 exp 0000000000000000 cur 187 last 0 00000100:00100000:3.0:1789302476.692432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789302476.692476:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789302476.692505:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936219c00 x1876219505172096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302476.692531:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505172096:0@lo:400: 00010000:00080000:3.0:1789302476.692548:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936218380 x1876219505171968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302476.692557:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505171968:0@lo:400: 00010000:00080000:3.0:1789302476.692596:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936219500 x1876219505172224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302476.692621:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505172224:0@lo:400: 00000020:00000080:0.0:1789302476.693023:0:6295:0:(genops.c:1384:class_connect()) connect: client ace2f696-3715-4928-b36c-02db3411d1a3, cookie 0x20be524657f11505 00000004:00100000:0.0:1789302476.693060:0:6295:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789302476.693067:0:6295:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789302476.693271:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789302476.693280:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505171840:12345-0@lo:400: 00000100:00100000:0.0:1789302476.693374:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505171840:12345-0@lo:400: Request processed in 95us (5959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302476.693382:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789302476.693412:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505172480 00000100:00100000:2.0:1789302476.693420:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505172480 00000100:00100000:2.0:1789302476.693457:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302476.693464:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505172480:12345-0@lo:13: 00002000:00000024:2.0:1789302476.693489:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302476.693540:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505172480:12345-0@lo:13: Request processed in 76us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302476.693547:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789302476.694510:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328ce00 x1876219505172480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302476.694534:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505172480:0@lo:13: 00000100:00100000:3.0:1789302476.694572:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505171840:0@lo:400: 00000100:00080000:1.0:1789302476.724136:0:6295:0:(import.c:65:import_set_state_nolock()) ffff9a69369ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302476.724246:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2350:x1876219484178432:12345-192.168.203.42@tcp:38: Request processed in 31887us (34896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302476.724260:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00010000:00010000:0.0:1789302476.877463:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302477.742173:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302477.742253:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302477.742633:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484178688 00000100:00100000:3.0:1789302477.742648:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484178688 00000100:00100000:2.0:1789302477.742652:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484178560 00000100:00100000:2.0:1789302477.742662:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484178560 00000100:00100000:3.0:1789302477.742751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:3.0:1789302477.742765:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:5579:x1876219484178688:12345-192.168.203.42@tcp:41: 00000004:00000024:3.0:1789302477.742827:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789302477.742932:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:5579:x1876219484178688:12345-192.168.203.42@tcp:41: Request processed in 159us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302477.742939:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:3.0:1789302477.742967:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:3.0:1789302477.742974:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:0:x1876219484178560:12345-192.168.203.42@tcp:41: 00000004:00000024:3.0:1789302477.742986:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789302477.743029:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:0:x1876219484178560:12345-192.168.203.42@tcp:41: Request processed in 56us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302477.743036:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00080000:0.0:1789302477.743102:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302477.749065:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302477.749166:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484178816 00000100:00100000:0.0:1789302477.749180:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484178816 00000100:00100000:0.0:1789302477.749270:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:0.0:1789302477.749282:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:5579:x1876219484178816:12345-192.168.203.42@tcp:40: 00000100:00100000:0.0:1789302477.749443:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:5579:x1876219484178816:12345-192.168.203.42@tcp:40: Request processed in 162us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302477.749451:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:0.0:1789302477.752638:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302477.752685:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302477.752725:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302477.752765:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302477.752812:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484178944 00000100:00100000:0.0:1789302477.752828:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484178944 00000100:00100000:0.0:1789302477.752911:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484179072 00000100:00100000:0.0:1789302477.752914:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484179072 00000100:00100000:0.0:1789302477.752933:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:0.0:1789302477.752952:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876219484178944:12345-192.168.203.42@tcp:8: 00010000:00080000:0.0:1789302477.753003:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:0.0:1789302477.753370:0:6699:0:(genops.c:1384:class_connect()) connect: client ace2f696-3715-4928-b36c-02db3411d1a3, cookie 0x20be524657f1150c 00002000:00100000:0.0:1789302477.753388:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ace2f696-3715-4928-b36c-02db3411d1a3/ffff9a6805801000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302477.753404:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789302477.753864:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789302477.753926:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a6805801800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302477.754334:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484179328 00000100:00100000:1.0:1789302477.754360:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484179328 00000100:00100000:1.0:1789302477.754433:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 128 00000100:00100000:1.0:1789302477.754446:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2354:x1876219484179328:12345-192.168.203.42@tcp:400: 00000100:00100000:2.0:1789302477.754552:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484179200 00000100:00100000:2.0:1789302477.754557:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484179200 00000100:00100000:2.0:1789302477.754594:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:2.0:1789302477.754601:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:5579:x1876219484179200:12345-192.168.203.42@tcp:33: 00000100:00100000:0.0:1789302477.755163:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2350:x1876219484178944:12345-192.168.203.42@tcp:8: Request processed in 2216us (2473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302477.755173:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:0.0:1789302477.755207:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:0.0:1789302477.755213:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876219484179072:12345-192.168.203.42@tcp:8: 00010000:00080000:0.0:1789302477.755247:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:0.0:1789302477.755282:0:6699:0:(genops.c:1384:class_connect()) connect: client ace2f696-3715-4928-b36c-02db3411d1a3, cookie 0x20be524657f11513 00002000:00100000:0.0:1789302477.755316:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ace2f696-3715-4928-b36c-02db3411d1a3/ffff9a6805805000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302477.755328:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789302477.755916:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789302477.755957:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a6805807000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302477.756208:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2354:x1876219484179328:12345-192.168.203.42@tcp:400: Request processed in 1761us (3479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302477.756218:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 128 00000100:00100000:0.0:1789302477.762572:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2350:x1876219484179072:12345-192.168.203.42@tcp:8: Request processed in 7336us (9785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302477.762591:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000004:00080000:2.0:1789302477.794525:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39840us 00000004:00200000:2.0:1789302477.841066:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789302477.841219:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:5579:x1876219484179200:12345-192.168.203.42@tcp:33: Request processed in 86609us (88586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302477.841232:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00010000:00010000:0.0:1789302477.901653:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302478.038663:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302478.038939:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484179456 00000100:00100000:0.0:1789302478.038953:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484179456 00000100:00100000:0.0:1789302478.039044:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:0.0:1789302478.039057:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:5621:x1876219484179456:12345-192.168.203.42@tcp:101: 00010000:00010000:0.0:1789302478.039086:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302478.039121:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6900031e00/0x20be524657f1151a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3587 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302478.039205:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6900030000/0x20be524657f11521 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302478.039223:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6900030000/0x20be524657f11521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302478.039241:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6900030000/0x20be524657f11521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302478.039282:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789302478.039347:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302478.039370:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6900030000/0x20be524657f11521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302478.039402:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6900031e00/0x20be524657f1151a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3587 expref: 8 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302478.039425:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6900030000/0x20be524657f11521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3587 expref: 7 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302478.039434:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:0.0:1789302478.039437:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302478.039460:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6900030000, rc 0) 00000100:00100000:0.0:1789302478.039532:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:5621:x1876219484179456:12345-192.168.203.42@tcp:101: Request processed in 478us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302478.039540:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00010000:00010000:0.0:1789302478.925801:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302479.949473:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302480.094834:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302480.095062:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484179584 00000100:00100000:3.0:1789302480.095077:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484179584 00000100:00100000:3.0:1789302480.095181:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:3.0:1789302480.095194:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:5673:x1876219484179584:12345-192.168.203.42@tcp:41: 00000004:00000024:3.0:1789302480.095251:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1789302480.095376:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302480.095688:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:5673:x1876219484179584:12345-192.168.203.42@tcp:41: Request processed in 495us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302480.095696:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:1.0:1789302480.106008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302480.106120:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484179712 00000100:00100000:2.0:1789302480.106133:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484179712 00000100:00100000:2.0:1789302480.106266:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:2.0:1789302480.106278:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ace2f696-3715-4928-b36c-02db3411d1a3+6:5673:x1876219484179712:12345-192.168.203.42@tcp:13: 00002000:00000024:2.0:1789302480.106347:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302480.106466:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ace2f696-3715-4928-b36c-02db3411d1a3+6:5673:x1876219484179712:12345-192.168.203.42@tcp:13: Request processed in 189us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302480.106474:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00080000:0.0:1789302480.110569:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302480.111347:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302480.112232:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484179840 00000100:00100000:2.0:1789302480.112249:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484179840 00000100:00100000:2.0:1789302480.112437:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:2.0:1789302480.112450:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ace2f696-3715-4928-b36c-02db3411d1a3+6:5673:x1876219484179840:12345-192.168.203.42@tcp:13: 00002000:00000024:2.0:1789302480.112510:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302480.112597:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ace2f696-3715-4928-b36c-02db3411d1a3+6:5673:x1876219484179840:12345-192.168.203.42@tcp:13: Request processed in 150us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302480.112606:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00080000:0.0:1789302480.113082:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789302480.973931:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302481.294503:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505172608:0@lo:13: 00000100:00100000:3.0:1789302481.294595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302481.306861:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505172608 00000100:00100000:3.0:1789302481.306883:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505172608 00000100:00100000:3.0:1789302481.307179:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789302481.307193:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505172608:12345-0@lo:13: 00002000:00000024:3.0:1789302481.307230:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302481.307359:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505172608:12345-0@lo:13: Request processed in 170us (12763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302481.307367:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789302481.307429:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328c000 x1876219505172608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302481.307454:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505172608:0@lo:13: 00000100:00080000:0.0:1789302481.307649:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302481.807569:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505172864:0@lo:400: 00000100:00100000:1.0:1789302481.807569:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505172992:0@lo:400: 00000100:00100000:3.0:1789302481.808784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302481.809193:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876219505173120:0@lo:400: 00000100:00100000:0.0:1789302481.809329:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505172736:0@lo:400: 00000100:00100000:0.0:1789302481.809376:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302481.809427:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505173248:0@lo:400: 00000100:00100000:0.0:1789302481.809456:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302481.809496:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302481.809504:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505173376:0@lo:13: 00000100:00100000:0.0:1789302481.809530:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302481.809570:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505172864 00000100:00100000:0.0:1789302481.809580:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505172864 00000100:00100000:0.0:1789302481.809649:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789302481.809660:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505172864:12345-0@lo:400: 00000100:00100000:0.0:1789302481.809721:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505172864:12345-0@lo:400: Request processed in 63us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302481.809730:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302481.809909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302481.809956:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505172736 00000100:00100000:2.0:1789302481.809961:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505172736 00000100:00100000:0.0:1789302481.810060:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505173120 00000100:00100000:0.0:1789302481.810065:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505173120 00000100:00100000:0.0:1789302481.810101:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302481.810118:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876219505173120:12345-0@lo:400: 00000100:00100000:0.0:1789302481.810162:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876219505173120:12345-0@lo:400: Request processed in 45us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302481.810170:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302481.810192:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505173248 00000100:00100000:0.0:1789302481.810196:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505173248 00000100:00100000:2.0:1789302481.810354:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789302481.810364:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505172736:12345-0@lo:400: 00000100:00100000:2.0:1789302481.810405:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505172736:12345-0@lo:400: Request processed in 44us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302481.810412:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789302481.810549:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302481.810557:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505173248:12345-0@lo:400: 00000100:00100000:0.0:1789302481.810590:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505173248:12345-0@lo:400: Request processed in 35us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302481.810597:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302481.810615:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505173376 00000100:00100000:0.0:1789302481.810619:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505173376 00000100:00100000:0.0:1789302481.810642:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302481.810649:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505173376:12345-0@lo:13: 00002000:00000024:0.0:1789302481.810664:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302481.810698:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505173376:12345-0@lo:13: Request processed in 49us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302481.810704:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789302481.810725:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302481.810730:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302481.810732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302481.810741:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505172992 00000100:00100000:0.0:1789302481.810744:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505172992 00000100:00100000:1.0:1789302481.810801:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876219505173120:0@lo:400: 00010000:00080000:1.0:1789302481.810836:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a690328ca80 x1876219505173376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302481.810862:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a690328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505173376:0@lo:13: 00000100:00100000:1.0:1789302481.810872:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505172736:0@lo:400: 00010000:00080000:1.0:1789302481.810880:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903e34700 x1876219505173248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302481.810887:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505173248:0@lo:400: 00000100:00100000:2.0:1789302481.811354:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505172864:0@lo:400: 00000100:00100000:0.0:1789302481.811911:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789302481.811921:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505172992:12345-0@lo:400: 00000100:00100000:2.0:1789302481.812393:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505172992:0@lo:400: 00000100:00080000:2.0:1789302481.812559:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302481.812839:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505172992:12345-0@lo:400: Request processed in 74us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302481.812860:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000001:00100000:2.0:1789302481.873782:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00010000:00010000:0.0:1789302481.998214:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789302482.409914:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000001:02000400:0.0:1789302482.647132:0:8306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789302482.798050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302482.798156:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484179968 00000100:00100000:0.0:1789302482.798170:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484179968 00000100:00100000:0.0:1789302482.798245:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:0.0:1789302482.798257:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2353:x1876219484179968:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789302482.798374:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2353:x1876219484179968:12345-192.168.203.42@tcp:400: Request processed in 119us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302482.798381:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:1.0:1789302482.799128:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302482.799166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302482.799191:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302482.799251:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484180096 00000100:00100000:0.0:1789302482.799257:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484180096 00000100:00100000:0.0:1789302482.799336:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:0.0:1789302482.799345:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484180096:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789302482.799393:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484180096:12345-192.168.203.42@tcp:400: Request processed in 50us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302482.799400:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:0.0:1789302482.799420:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484180352 00000100:00100000:0.0:1789302482.799423:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484180352 00000100:00100000:0.0:1789302482.799459:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484180224 00000100:00100000:0.0:1789302482.799462:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484180224 00000100:00100000:0.0:1789302482.799476:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:0.0:1789302482.799482:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2351:x1876219484180352:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789302482.799505:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2351:x1876219484180352:12345-192.168.203.42@tcp:400: Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302482.799512:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:0.0:1789302482.799522:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:0.0:1789302482.799538:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484180224:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789302482.799575:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484180224:12345-192.168.203.42@tcp:400: Request processed in 37us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302482.799582:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00080000:1.0:1789302482.800124:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302482.800131:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302482.800134:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1789302482.880789:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00010000:00010000:0.0:1789302483.022692:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302484.046790:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302485.069468:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789302485.952166:0:8454:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3bdd3160 20000000:00000080:3.0:1789302485.952188:0:8454:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a693c3b7800 uarg=0000000000000000 20000000:01000000:3.0:1789302485.952235:0:8454:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789302485.952237:0:8454:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789302485.952241:0:8454:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789302485.952247:0:8454:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789302485.952253:0:8454:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789302485.952271:0:8454:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789302485.952274:0:8454:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789302485.952906:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789302485.952911:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789302485.956508:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789302485.959000:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789302485.959106:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789302485.959147:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789302485.959168:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789302485.959172:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789302485.967870:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789302485.968943:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789302485.969007:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789302485.969064:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789302485.969080:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789302485.969083:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789302485.972735:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789302485.973627:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789302485.973692:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789302485.973731:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1789302485.973746:0:8454:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789302485.973749:0:8454:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789302485.976700:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789302485.981155:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789302485.981249:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789302485.981947:0:8454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1789302485.981981:0:8454:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789302485.982009:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982032:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1141e expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982041:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11448 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982049:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11472 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982056:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11480 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982063:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1148e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982087:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f114aa expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982095:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f114d4 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982107:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982115:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982124:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982174:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.982192:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 9 pid: 5838 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.982212:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505173504:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302485.983589:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.983610:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 9 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.983642:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505173632:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302485.983733:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f114d4 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.983742:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f114d4 expref: 18 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.983754:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505173760:0@lo:104: 00000100:00100000:0.0:1789302485.983815:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302485.983986:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f114aa expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.983996:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f114aa expref: 18 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.984005:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505173888:0@lo:104: 00000100:00100000:0.0:1789302485.984036:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302485.984092:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789302485.984107:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505173760 00000100:00100000:0.0:1789302485.984117:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505173760 00000100:00100000:0.0:1789302485.984164:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505173888 00000100:00100000:0.0:1789302485.984168:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505173888 00000100:00100000:0.0:1789302485.984187:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302485.984199:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:8454:x1876219505173760:12345-0@lo:104: 00010000:00010000:0.0:1789302485.984215:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.984273:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302485.984280:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:8454:x1876219505173760:12345-0@lo:104: Request processed in 83us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302485.984328:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302485.984354:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302485.984361:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c761850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505173888:12345-0@lo:104: 00010000:00010000:0.0:1789302485.984369:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.984404:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789302485.984409:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c761850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505173888:12345-0@lo:104: Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302485.984415:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1789302485.984458:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302485.984466:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.984474:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:0.0:1789302485.984479:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.984489:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302485.984497:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302485.984503:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302485.984521:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302485.984536:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.984543:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302485.984581:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.984590:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c8000/0x20be524657f114d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f114db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.984610:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302485.984612:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302485.984613:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302485.984654:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1148e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302485.984661:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505174016:0@lo:103: 00000100:00100000:3.0:1789302485.984698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302485.984744:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505174016 00000100:00100000:3.0:1789302485.984747:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505174016 00010000:00010000:3.0:1789302485.984781:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f114d4 expref: 19 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302485.984816:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789302485.984833:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505174016:12345-0@lo:103: 00010000:00010000:3.0:1789302485.984846:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302485.984852:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f114d4 expref: 19 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.984928:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1148e expref: 19 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.984940:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505174144:0@lo:104: 00000100:00100000:0.0:1789302485.984966:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302485.984990:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505174144 00000100:00100000:0.0:1789302485.984995:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505174144 00000100:00100000:0.0:1789302485.985018:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302485.985024:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505174144:12345-0@lo:104: 00010000:00010000:0.0:1789302485.985033:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.985067:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302485.985072:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505174144:12345-0@lo:104: Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302485.985078:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789302485.985096:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302485.985101:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.985114:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:0.0:1789302485.985117:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.985125:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302485.985132:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302485.985137:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789302485.985156:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.985164:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302485.985174:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.985181:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f1148e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.985195:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302485.985197:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302485.985199:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302485.985368:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505174272:0@lo:103: 00000100:00100000:1.0:1789302485.985402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302485.986644:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505174272 00000100:00100000:2.0:1789302485.986656:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505174272 00010000:00010000:2.0:1789302485.986697:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1148e expref: 20 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302485.986746:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789302485.986755:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+20:3306:x1876219505174272:12345-0@lo:103: 00010000:00010000:2.0:1789302485.986769:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302485.987019:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1148e expref: 20 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.988497:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f114d4 expref: 20 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.988531:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302485.988587:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f11480 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.988603:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f11480 expref: 20 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.988655:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505174400:0@lo:104: 00000100:00100000:3.0:1789302485.988670:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505174016:12345-0@lo:103: Request processed in 3839us (3971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302485.988679:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302485.988703:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302485.988937:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505174016:0@lo:103: 00000100:00100000:0.0:1789302485.989014:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505174400 00010000:00010000:1.0:1789302485.989016:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302485.989020:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302485.989022:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302485.989023:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505174400 00010000:00010000:3.0:1789302485.989072:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.989075:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789302485.989082:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031000 already unused, calling callback (ffffffffc1a60c20) 00000100:00100000:0.0:1789302485.989085:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505174400:12345-0@lo:104: 10000000:00010000:3.0:1789302485.989087:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.989096:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989099:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302485.989104:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302485.989109:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302485.989139:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989141:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302485.989147:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505174400:12345-0@lo:104: Request processed in 64us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302485.989153:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1789302485.989154:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302485.989179:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989180:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302485.989185:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.989187:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900031000/0x20be524657f114aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f114b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989192:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6923abf200 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:0.0:1789302485.989195:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989202:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.989204:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302485.989205:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302485.989207:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789302485.989210:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302485.989216:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789302485.989218:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505174528:0@lo:103: 00010000:00010000:0.0:1789302485.989238:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989245:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789302485.989247:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302485.989251:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989257:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6923abf200/0x20be524657f11480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989267:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302485.989269:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302485.989270:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302485.989280:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302485.989310:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505174656:0@lo:103: 00010000:00010000:0.0:1789302485.989317:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f11472 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989327:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f11472 expref: 19 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302485.989332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302485.989337:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505174784:0@lo:104: 00000100:00100000:3.0:1789302485.989354:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505174528 00000100:00100000:3.0:1789302485.989359:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505174528 00000100:00100000:0.0:1789302485.989359:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789302485.989377:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f114aa expref: 20 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.989377:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505174784 00000100:00100000:0.0:1789302485.989380:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505174784 00000100:00100000:3.0:1789302485.989393:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505174656 00000100:00100000:3.0:1789302485.989395:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505174656 00000100:00100000:0.0:1789302485.989395:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789302485.989401:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505174784:12345-0@lo:104: 00010000:00010000:3.0:1789302485.989405:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11480 expref: 21 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989408:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.989438:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302485.989443:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505174784:12345-0@lo:104: Request processed in 43us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302485.989456:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789302485.989484:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f11448 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302485.989494:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789302485.989494:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f11448 expref: 21 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302485.989500:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+21:3303:x1876219505174528:12345-0@lo:103: 00000100:00100000:0.0:1789302485.989502:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505174912:0@lo:104: 00010000:00010000:3.0:1789302485.989510:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302485.989521:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f114aa expref: 21 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.989524:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789302485.989531:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f114aa expref: 21 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.989542:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505174912 00010000:00010000:3.0:1789302485.989544:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302485.989545:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505174912 00000100:00100000:0.0:1789302485.989561:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789302485.989567:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505174912:12345-0@lo:104: 00000100:00100000:3.0:1789302485.989569:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+21:3303:x1876219505174528:12345-0@lo:103: Request processed in 70us (322us total) trans 0 rc 0/0 00010000:00010000:0.0:1789302485.989574:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302485.989575:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789302485.989587:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302485.989592:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+20:3303:x1876219505174656:12345-0@lo:103: 00010000:00010000:3.0:1789302485.989599:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302485.989602:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789302485.989603:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11480 expref: 20 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.989607:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505174912:12345-0@lo:104: Request processed in 41us (82us total) trans 0 rc 0/0 00010000:00010000:3.0:1789302485.989611:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f11480 expref: 20 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.989612:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789302485.989621:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302485.989642:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+20:3303:x1876219505174656:12345-0@lo:103: Request processed in 50us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302485.989648:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302485.989672:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505174656:0@lo:103: 00000100:00100000:3.0:1789302485.989681:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505174528:0@lo:103: 00010000:00010000:3.0:1789302485.989697:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302485.989701:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.989718:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900030c00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302485.989722:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.989729:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302485.989736:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.989738:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1148e expref: 19 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302485.989741:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302485.989860:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302485.989866:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.989873:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9c00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302485.989876:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.989883:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302485.989890:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302485.989896:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302485.989930:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.989937:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302485.989951:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.989958:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f11472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11479 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.989960:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302485.989971:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302485.989972:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302485.989974:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302485.989999:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505174272:12345-0@lo:103: Request processed in 3246us (4596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302485.990007:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789302485.990059:0:8459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302485.990061:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505175040:0@lo:103: 00010000:00010000:1.0:1789302485.990066:0:8459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302485.990071:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990078:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c9c00/0x20be524657f11448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1144f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302485.990087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302485.990096:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302485.990097:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302485.990099:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302485.990111:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302485.990117:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505175168:0@lo:103: 00000100:00100000:2.0:1789302485.990156:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302485.990162:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505174272:0@lo:103: 00000100:00100000:2.0:1789302485.990196:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505175040 00000100:00100000:2.0:1789302485.990201:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505175040 00000100:00100000:1.0:1789302485.990205:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505175168 00000100:00100000:1.0:1789302485.990207:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505175168 00010000:00010000:2.0:1789302485.990221:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11472 expref: 20 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990221:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11448 expref: 20 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302485.990244:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302485.990252:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505175040:12345-0@lo:103: 00000100:00100000:1.0:1789302485.990305:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789302485.990313:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505175168:12345-0@lo:103: 00010000:00010000:0.0:1789302485.990313:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1141e expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990320:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302485.990323:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1141e expref: 20 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990324:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11448 expref: 20 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990333:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f11448 expref: 20 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.990333:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505175296:0@lo:104: 00010000:00010000:1.0:1789302485.990343:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302485.990356:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302485.990368:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505175168:12345-0@lo:103: Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302485.990375:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789302485.990381:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505175296 00000100:00100000:0.0:1789302485.990385:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505175296 00000100:00100000:0.0:1789302485.990418:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789302485.990424:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505175296:12345-0@lo:104: 00010000:00010000:0.0:1789302485.990434:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.990477:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302485.990482:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:8454:x1876219505175296:12345-0@lo:104: Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302485.990489:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789302485.990505:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302485.990510:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.990510:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9a80 going to sleep for 11 seconds 00010000:00010000:1.0:1789302485.990517:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6923abec00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302485.990520:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.990526:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900031a00/0x20be524657f114db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f114d4 expref: 19 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990537:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.990537:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505173760:0@lo:104: 10000000:00010000:1.0:1789302485.990543:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.990548:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7a00/0x20be524657f114b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f114aa expref: 18 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302485.990550:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789302485.990555:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505173888:0@lo:104: 00010000:00010000:0.0:1789302485.990565:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abe000/0x20be524657f11495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1148e expref: 17 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990568:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990574:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789302485.990577:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505174144:0@lo:104: 00010000:00010000:1.0:1789302485.990584:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.990587:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba6400/0x20be524657f11487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f11480 expref: 16 pid: 5839 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.990592:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6923abec00/0x20be524657f1141e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11425 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.990595:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505174400:0@lo:104: 00000100:00100000:0.0:1789302485.990602:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505174784:0@lo:104: 00010000:00010000:1.0:1789302485.990606:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302485.990608:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302485.990610:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302485.990632:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abfe00/0x20be524657f1144f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f11448 expref: 15 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.990642:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505174912:0@lo:104: 00000100:00100000:0.0:1789302485.990651:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505175296:0@lo:104: 00000100:00100000:3.0:1789302485.990659:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505175424:0@lo:103: 00000100:00100000:3.0:1789302485.990686:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302485.990730:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302485.990736:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11472 expref: 14 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.990745:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f11472 expref: 14 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302485.990848:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505175424 00000100:00100000:1.0:1789302485.990852:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505175424 00010000:00010000:1.0:1789302485.990867:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1141e expref: 15 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302485.990892:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789302485.990898:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690bb70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+15:3303:x1876219505175424:12345-0@lo:103: 00010000:00010000:1.0:1789302485.990906:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302485.990910:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1141e expref: 15 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.991122:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1141e expref: 15 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.991135:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c9400/0x20be524657f11425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1141e expref: 15 pid: 5840 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.991144:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302485.991181:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690bb70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+14:3303:x1876219505175424:12345-0@lo:103: Request processed in 283us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302485.991188:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789302485.991244:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505175424:0@lo:103: 00000100:00100000:3.0:1789302485.991351:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505175168:0@lo:103: 00000100:00100000:3.0:1789302485.992611:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302485.992661:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484180480 00000100:00100000:1.0:1789302485.992671:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484180480 00010000:00010000:1.0:1789302485.992709:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 10 pid: 5838 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302485.992729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302485.992739:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484180608 00000100:00100000:1.0:1789302485.992742:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484180608 00000100:00100000:3.0:1789302485.992765:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:3.0:1789302485.992785:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:2352:x1876219484180480:12345-192.168.203.42@tcp:103: 00010000:00010000:3.0:1789302485.992801:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302485.992808:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 11 pid: 5838 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.992813:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 11 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.992830:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 11 pid: 5838 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302485.992848:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302485.992911:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:2352:x1876219484180480:12345-192.168.203.42@tcp:103: Request processed in 136us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302485.992919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:1.0:1789302485.993057:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:1.0:1789302485.993066:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2352:x1876219484180608:12345-192.168.203.42@tcp:103: 00010000:00010000:1.0:1789302485.993076:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302485.993080:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 10 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.993089:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 10 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302485.993112:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302485.993133:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2352:x1876219484180608:12345-192.168.203.42@tcp:103: Request processed in 69us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302485.993140:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00010000:00010000:0.0:1789302485.993364:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abf000/0x20be524657f114f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b352c expref: 9 pid: 5838 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.993381:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505173504:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302485.993392:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c9800/0x20be524657f114e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3525 expref: 8 pid: 5840 timeout: 297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302485.993401:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8454:1876219505173632:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302485.993454:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993560:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abe600/0x20be524657f11479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f11472 expref: 13 pid: 5838 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993579:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993589:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993609:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993617:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993624:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993649:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993656:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302485.993661:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993670:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993690:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302485.993702:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302485.993807:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505175040:12345-0@lo:103: Request processed in 3556us (3718us total) trans 0 rc 0/0 00010000:00010000:0.0:1789302485.993811:0:8454:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302485.993815:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789302485.993830:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302485.993838:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900031e00/0x20be524657f11528 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302485.994832:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505175040:0@lo:103: 00010000:00010000:3.0:1789302486.094003:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302486.413507:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302486.413544:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505175552:0@lo:13: 00000100:00100000:0.0:1789302486.413635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302486.413823:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505175552 00000100:00100000:3.0:1789302486.413835:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505175552 00000100:00100000:3.0:1789302486.413966:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789302486.413978:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505175552:12345-0@lo:13: 00002000:00000024:3.0:1789302486.414021:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302486.414088:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505175552:12345-0@lo:13: Request processed in 112us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302486.414096:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789302486.414396:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c395c00 x1876219505175552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302486.414492:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505175552:0@lo:13: 00000100:00080000:1.0:1789302486.418750:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302486.926110:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505175808:0@lo:400: 00000100:00100000:3.0:1789302486.926125:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505175680:0@lo:400: 00000100:00100000:2.0:1789302486.926249:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505175936:0@lo:400: 00000100:00100000:1.0:1789302486.926492:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505176064:0@lo:400: 00000100:00100000:0.0:1789302486.932618:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302486.932723:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505176320:0@lo:400: 00000100:00100000:0.0:1789302486.932768:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302486.932858:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505176320 00000100:00100000:0.0:1789302486.932869:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505176320 00000100:00100000:0.0:1789302486.933359:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302486.933377:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505176320:12345-0@lo:400: 00000100:00100000:0.0:1789302486.933463:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505176320:12345-0@lo:400: Request processed in 94us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302486.933471:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789302486.933529:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362ac700 x1876219505176320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302486.933545:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505176320:0@lo:400: 00000100:00080000:0.0:1789302486.933583:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302486.935316:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505175808 00000100:00100000:0.0:1789302486.935336:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505175808 00000100:00100000:0.0:1789302486.935398:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302486.935409:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505175808:12345-0@lo:400: 00000100:00100000:0.0:1789302486.935512:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505175808:12345-0@lo:400: Request processed in 105us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302486.935519:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789302486.935574:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505175808:0@lo:400: 00000100:00100000:2.0:1789302486.938591:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302486.938648:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505175936 00000100:00100000:3.0:1789302486.938651:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302486.938660:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505175936 00000100:00100000:3.0:1789302486.938706:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505176192:0@lo:400: 00000100:00100000:2.0:1789302486.938731:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302486.938744:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505175936:12345-0@lo:400: 00000100:00100000:3.0:1789302486.938750:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302486.938781:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505176192 00000100:00100000:3.0:1789302486.938785:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505176192 00000100:00100000:3.0:1789302486.938829:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302486.938837:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505176192:12345-0@lo:400: 00000100:00100000:3.0:1789302486.938873:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505176192:12345-0@lo:400: Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302486.938881:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302486.938931:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505176192:0@lo:400: 00000100:00080000:3.0:1789302486.938975:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302486.938988:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505176448:0@lo:13: 00000100:00100000:3.0:1789302486.939027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302486.939053:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505176448 00000100:00100000:3.0:1789302486.939057:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505176448 00000100:00100000:3.0:1789302486.939085:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789302486.939092:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505176448:12345-0@lo:13: 00000100:00100000:2.0:1789302486.939374:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505175936:12345-0@lo:400: Request processed in 632us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302486.939383:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789302486.939593:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505175680 00000100:00100000:1.0:1789302486.939598:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505175680 00000100:00100000:1.0:1789302486.939635:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789302486.939644:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505175680:12345-0@lo:400: 00000100:00100000:1.0:1789302486.939688:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+12:3305:x1876219505175680:12345-0@lo:400: Request processed in 47us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302486.939695:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789302486.939748:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505175680:0@lo:400: 00000100:00100000:1.0:1789302486.939796:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302486.939830:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505176064 00000100:00100000:1.0:1789302486.939833:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505176064 00000100:00100000:1.0:1789302486.939862:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302486.939868:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505176064:12345-0@lo:400: 00000100:00100000:1.0:1789302486.939896:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505176064:12345-0@lo:400: Request processed in 29us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302486.939902:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789302486.939930:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362ae680 x1876219505176064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302486.939942:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505176064:0@lo:400: 00002000:00000024:3.0:1789302486.940631:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302486.940736:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505176448:12345-0@lo:13: Request processed in 1642us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302486.940746:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789302486.940793:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c395500 x1876219505176448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302486.940825:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505176448:0@lo:13: 00000100:00100000:3.0:1789302486.940872:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505175936:0@lo:400: 00010000:00010000:1.0:1789302487.122146:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789302487.693440:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789302487.693525:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6936077800 from 39 10000000:01000000:3.0:1789302487.693532:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789302487.693606:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302487.693620:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302487.693634:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302487.693664:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505176576:0@lo:101: 00000100:00100000:3.0:1789302487.693770:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.693965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505176576 00000100:00100000:1.0:1789302487.693977:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505176576 00000100:00100000:3.0:1789302487.694022:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302487.694057:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789302487.694068:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+12:5842:x1876219505176576:12345-0@lo:101: 00010000:00010000:1.0:1789302487.694087:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302487.694104:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c9400/0x20be524657f11536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1152f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302487.694145:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c9400/0x20be524657f11536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1152f expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302487.694158:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c9400/0x20be524657f11536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1152f expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302487.694168:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9400, rc 0) 00000100:00100000:1.0:1789302487.694227:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505176576:12345-0@lo:101: Request processed in 160us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302487.694234:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789302487.694408:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505176576:0@lo:101: 00010000:00010000:3.0:1789302487.694426:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302487.694436:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302487.694501:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505176704:0@lo:501: 00000100:00100000:3.0:1789302487.694527:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302487.694633:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505176704 00000100:00100000:2.0:1789302487.694639:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505176704 00000100:00100000:2.0:1789302487.694690:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789302487.694698:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505176704:12345-0@lo:501: 00000100:00100000:2.0:1789302487.695040:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505176704:12345-0@lo:501: Request processed in 342us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.695047:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789302487.697745:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302487.697819:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505176704:0@lo:501: 00000100:00100000:3.0:1789302487.697898:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505176832:0@lo:503: 00000100:00100000:3.0:1789302487.698007:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302487.698051:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302487.698910:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505176832 00000100:00100000:1.0:1789302487.698923:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505176832 00000100:00100000:1.0:1789302487.699000:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789302487.699011:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505176832:12345-0@lo:503: 00000100:00100000:3.0:1789302487.700166:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505176832:0@lo:503: 00000100:00100000:1.0:1789302487.700311:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505176832:12345-0@lo:503: Request processed in 1278us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302487.700333:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789302487.700920:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8472:1876219505176960:0@lo:502: 00000100:00100000:3.0:1789302487.700987:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302487.701088:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.701128:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505176960 00000100:00100000:2.0:1789302487.701137:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505176960 00000100:00100000:2.0:1789302487.701220:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789302487.701230:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:8472:x1876219505176960:12345-0@lo:502: 00000100:00100000:2.0:1789302487.701572:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:8472:x1876219505176960:12345-0@lo:502: Request processed in 343us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.701579:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789302487.701664:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8472:1876219505176960:0@lo:502: 00000100:00100000:3.0:1789302487.701712:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8472:1876219505177088:0@lo:502: 00000100:00100000:3.0:1789302487.701743:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302487.702117:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.702187:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505177088 00000100:00100000:0.0:1789302487.702193:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505177088 00000100:00100000:0.0:1789302487.702222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789302487.702232:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:8472:x1876219505177088:12345-0@lo:502: 00000100:00100000:0.0:1789302487.702733:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+13:8472:x1876219505177088:12345-0@lo:502: Request processed in 500us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.702741:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789302487.702988:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8472:1876219505177088:0@lo:502: 00000040:00080000:3.0:1789302487.703029:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789302487.703243:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789302487.703272:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789302487.703765:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.703782:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302487.703794:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789302487.703798:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789302487.703801:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789302487.703849:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.703859:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.703870:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302487.703891:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177216:0@lo:101: 00000100:00100000:0.0:1789302487.703945:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.704000:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.704074:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505177216 00000100:00100000:2.0:1789302487.704080:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505177216 00000100:00100000:2.0:1789302487.704130:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789302487.704140:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+13:5842:x1876219505177216:12345-0@lo:101: 00010000:00010000:2.0:1789302487.704154:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302487.704169:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abe600/0x20be524657f11544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1153d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.704197:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abe600/0x20be524657f11544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1153d expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.704208:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abe600/0x20be524657f11544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1153d expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.704217:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abe600, rc 0) 00000100:00100000:2.0:1789302487.704276:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505177216:12345-0@lo:101: Request processed in 138us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.704327:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789302487.704585:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177216:0@lo:101: 00010000:00010000:3.0:1789302487.704605:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302487.704616:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302487.704677:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177344:0@lo:501: 00000100:00100000:3.0:1789302487.704706:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302487.704728:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302487.704789:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505177344 00000100:00100000:1.0:1789302487.704794:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505177344 00000100:00100000:1.0:1789302487.704849:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789302487.704858:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505177344:12345-0@lo:501: 00000100:00100000:1.0:1789302487.705177:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505177344:12345-0@lo:501: Request processed in 320us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302487.705184:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789302487.705567:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177344:0@lo:501: 00000100:00100000:3.0:1789302487.705610:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177472:0@lo:503: 00000100:00100000:3.0:1789302487.705667:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302487.705703:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.705751:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505177472 00000100:00100000:0.0:1789302487.705757:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505177472 00000100:00100000:0.0:1789302487.705796:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789302487.705804:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505177472:12345-0@lo:503: 00000100:00100000:0.0:1789302487.706367:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505177472:12345-0@lo:503: Request processed in 562us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302487.706933:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177472:0@lo:503: 00000100:00100000:0.0:1789302487.707531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789302487.708077:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8473:1876219505177600:0@lo:502: 00000100:00100000:3.0:1789302487.708152:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302487.708199:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.708273:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505177600 00000100:00100000:2.0:1789302487.708282:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505177600 00000100:00100000:2.0:1789302487.708369:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789302487.708775:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:8473:x1876219505177600:12345-0@lo:502: 00000100:00100000:2.0:1789302487.709059:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+14:8473:x1876219505177600:12345-0@lo:502: Request processed in 290us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.709065:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789302487.709202:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8473:1876219505177600:0@lo:502: 00000020:01000000:3.0:1789302487.709235:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302487.709247:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302487.709250:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789302487.709257:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789302487.709303:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8473:1876219505177728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302487.709350:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.709567:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505177728 00000100:00100000:0.0:1789302487.709573:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505177728 00000100:00100000:0.0:1789302487.709603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789302487.709611:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+14:8473:x1876219505177728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302487.709751:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+14:8473:x1876219505177728:12345-0@lo:502:llog_process_th.0 Request processed in 140us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.709759:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789302487.710170:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1789302487.710189:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8473:1876219505177728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302487.710214:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302487.710221:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302487.710223:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789302487.710228:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789302487.710989:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789302487.711022:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789302487.711034:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.711049:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302487.711061:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789302487.711064:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6902e2c800 from 39 10000000:01000000:0.0:1789302487.711068:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789302487.711107:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.711134:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.711146:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302487.711171:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.711242:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.712075:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.712166:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505177856 00000100:00100000:2.0:1789302487.712176:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505177856 00000100:00100000:2.0:1789302487.712230:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789302487.712241:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+14:5842:x1876219505177856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302487.712261:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302487.712281:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abee00/0x20be524657f11552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1154b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.712419:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abee00/0x20be524657f11552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1154b expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.712432:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abee00/0x20be524657f11552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1154b expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.712441:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abee00, rc 0) 00000100:00100000:2.0:1789302487.712517:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505177856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 277us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.712524:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789302487.712623:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302487.712644:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.712654:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302487.712729:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.712762:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.712795:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.712855:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505177984 00000100:00100000:2.0:1789302487.712873:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505177984 00000100:00100000:2.0:1789302487.712905:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789302487.712912:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505177984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302487.713217:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505177984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.713225:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789302487.713333:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505177984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.713366:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505178112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.713405:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.713418:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.713544:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505178112 00000100:00100000:2.0:1789302487.713549:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505178112 00000100:00100000:2.0:1789302487.713580:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789302487.713587:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505178112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302487.713748:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505178112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.713754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789302487.713853:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505178112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.715188:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8474:1876219505178240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302487.715268:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.715399:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.715671:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505178240 00000100:00100000:2.0:1789302487.715679:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505178240 00000100:00100000:2.0:1789302487.716012:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789302487.716024:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:8474:x1876219505178240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302487.716391:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+15:8474:x1876219505178240:12345-0@lo:502:llog_process_th.0 Request processed in 369us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.716399:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789302487.716506:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8474:1876219505178240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302487.716571:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8474:1876219505178368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302487.716611:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.717160:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.717242:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505178368 00000100:00100000:0.0:1789302487.717260:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505178368 00000100:00100000:0.0:1789302487.717307:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789302487.717325:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:8474:x1876219505178368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302487.717750:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:8474:x1876219505178368:12345-0@lo:502:llog_process_th.0 Request processed in 434us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.717759:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789302487.717993:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8474:1876219505178368:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789302487.718023:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789302487.718221:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789302487.718244:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789302487.718256:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.718271:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302487.718310:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789302487.718323:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789302487.718327:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789302487.718362:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.718371:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.718391:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302487.718412:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505178496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.718452:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.718486:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9180 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.718555:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505178496 00000100:00100000:2.0:1789302487.718561:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505178496 00000100:00100000:2.0:1789302487.718606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789302487.718615:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+15:5842:x1876219505178496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302487.718628:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302487.718642:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abe400/0x20be524657f11560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11559 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.718680:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abe400/0x20be524657f11560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11559 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.718691:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abe400/0x20be524657f11560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11559 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.718700:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abe400, rc 0) 00000100:00100000:2.0:1789302487.718743:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505178496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.718749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789302487.719026:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505178496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302487.719043:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302487.719053:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302487.719106:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505178624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.719134:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.719198:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302487.719275:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505178624 00000100:00100000:3.0:1789302487.719281:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505178624 00000100:00100000:2.0:1789302487.719535:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789302487.719545:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505178624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302487.719869:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505178624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.719877:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789302487.720020:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505178624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.720066:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505178752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.720107:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.720137:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.720182:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505178752 00000100:00100000:0.0:1789302487.720188:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505178752 00000100:00100000:0.0:1789302487.720220:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789302487.720227:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505178752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.720442:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505178752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.720448:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789302487.720698:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505178752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.721097:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8475:1876219505178880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302487.721143:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.721175:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.721225:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505178880 00000100:00100000:0.0:1789302487.721230:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505178880 00000100:00100000:0.0:1789302487.721267:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789302487.721276:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:8475:x1876219505178880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302487.721627:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:8475:x1876219505178880:12345-0@lo:502:llog_process_th.0 Request processed in 352us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.721635:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789302487.721797:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8475:1876219505178880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302487.723272:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302487.723309:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302487.723321:0:8475:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789302487.723332:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789302487.723514:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8475:1876219505179008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302487.723612:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.723656:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.724496:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505179008 00000100:00100000:0.0:1789302487.724510:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505179008 00000100:00100000:0.0:1789302487.724578:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789302487.724589:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:8475:x1876219505179008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302487.724911:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:8475:x1876219505179008:12345-0@lo:502:llog_process_th.0 Request processed in 323us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.724919:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789302487.725088:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8475:1876219505179008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302487.725196:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302487.725205:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302487.725208:0:8475:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789302487.725214:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789302487.726232:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789302487.726263:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789302487.726277:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.726526:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302487.726559:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789302487.726562:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6905909800 from 39 10000000:01000000:0.0:1789302487.726565:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789302487.726610:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.726620:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.726632:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302487.726661:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.726739:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.726795:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.727461:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505179136 00000100:00100000:2.0:1789302487.727472:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505179136 00000100:00100000:2.0:1789302487.727527:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789302487.727537:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505179136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302487.727554:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302487.727573:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abf600/0x20be524657f1156e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11567 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.727604:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abf600/0x20be524657f1156e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11567 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.727617:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abf600/0x20be524657f1156e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11567 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.727639:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abf600, rc 0) 00000100:00100000:2.0:1789302487.727700:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505179136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.727708:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789302487.728360:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302487.728391:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302487.728402:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302487.728491:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.728529:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.728574:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.728690:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505179264 00000100:00100000:0.0:1789302487.728696:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505179264 00000100:00100000:0.0:1789302487.728734:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789302487.728742:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505179264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.729097:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505179264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.729105:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789302487.729337:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.729386:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.729435:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.729468:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.729572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505179392 00000100:00100000:2.0:1789302487.729579:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505179392 00000100:00100000:2.0:1789302487.729619:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789302487.729628:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505179392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302487.729823:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505179392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.729830:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789302487.730736:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.731382:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8476:1876219505179520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302487.731460:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.731508:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.731669:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505179520 00000100:00100000:2.0:1789302487.731678:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505179520 00000100:00100000:2.0:1789302487.731722:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789302487.731732:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:8476:x1876219505179520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302487.732035:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:8476:x1876219505179520:12345-0@lo:502:llog_process_th.0 Request processed in 302us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.732044:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789302487.734360:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8476:1876219505179520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302487.734480:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8476:1876219505179648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302487.734565:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.734608:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5300 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.735174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505179648 00000100:00100000:0.0:1789302487.735185:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505179648 00000100:00100000:0.0:1789302487.735250:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789302487.735260:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:8476:x1876219505179648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302487.735879:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:8476:x1876219505179648:12345-0@lo:502:llog_process_th.0 Request processed in 618us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.735897:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789302487.737460:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8476:1876219505179648:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789302487.737521:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789302487.737829:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789302487.737859:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302487.737872:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.737885:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302487.737918:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789302487.737921:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789302487.737924:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789302487.737970:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.737979:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.737990:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302487.738017:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c394a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302487.738085:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302487.738150:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302487.738652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505179776 00000100:00100000:1.0:1789302487.738663:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505179776 00000100:00100000:1.0:1789302487.738725:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789302487.738736:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505179776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302487.738756:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302487.738784:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c9c00/0x20be524657f1157c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11575 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302487.738827:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c9c00/0x20be524657f1157c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11575 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302487.738840:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c9c00/0x20be524657f1157c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11575 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302487.738850:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9c00, rc 0) 00000100:00100000:1.0:1789302487.738907:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505179776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302487.738914:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789302487.739474:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c394a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302487.739500:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.739514:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302487.739600:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.739640:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.739681:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789302487.740283:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505179904 00000100:00100000:1.0:1789302487.740311:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505179904 00000100:00100000:1.0:1789302487.740708:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789302487.740718:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505179904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302487.741163:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505179904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 444us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302487.741171:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789302487.745602:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505179904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302487.745697:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c394e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505180032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302487.745799:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302487.745916:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.750772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505180032 00000100:00100000:0.0:1789302487.750797:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505180032 00000100:00100000:2.0:1789302487.750965:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789302487.750978:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505180032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302487.751344:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505180032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 368us (5543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.751353:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789302487.751537:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c394e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505180032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302487.753071:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8477:1876219505180160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302487.753275:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302487.753581:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302487.753663:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505180160 00000100:00100000:0.0:1789302487.753673:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505180160 00000100:00100000:0.0:1789302487.753838:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789302487.753849:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:8477:x1876219505180160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302487.754244:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:8477:x1876219505180160:12345-0@lo:502:llog_process_th.0 Request processed in 397us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.754254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789302487.754409:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8477:1876219505180160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302487.754446:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302487.754465:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302487.754468:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789302487.754477:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789302487.754513:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8477:1876219505180288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302487.754553:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302487.759068:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505180288 00000100:00100000:1.0:1789302487.759091:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505180288 00000100:00100000:1.0:1789302487.759162:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789302487.759174:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:8477:x1876219505180288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302487.759517:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302487.759610:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:8477:x1876219505180288:12345-0@lo:502:llog_process_th.0 Request processed in 437us (5055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302487.759620:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789302487.759696:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8477:1876219505180288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302487.759742:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302487.759910:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302487.759914:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789302487.759921:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789302487.760183:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789302487.760207:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789302487.760222:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.760251:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302487.760263:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789302487.760266:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a690a593380 from 1 10000000:01000000:0.0:1789302487.760270:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789302487.760453:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.760463:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.760473:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302487.760497:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505180416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.760553:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.760585:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302487.760689:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505180416 00000100:00100000:2.0:1789302487.760697:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505180416 00000100:00100000:2.0:1789302487.761038:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789302487.761050:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505180416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302487.761065:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302487.761082:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abe200/0x20be524657f1158a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11583 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.761122:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abe200/0x20be524657f1158a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11583 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.761136:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abe200/0x20be524657f1158a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11583 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302487.761146:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abe200, rc 0) 00000100:00100000:2.0:1789302487.761199:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505180416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.761206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789302487.761306:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505180416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302487.761323:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1158a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.761334:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1158a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302487.761392:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505180544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302487.761419:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302487.762059:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302487.762152:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505180544 00000100:00100000:3.0:1789302487.762160:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505180544 00000100:00100000:3.0:1789302487.762195:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789302487.762204:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505180544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302487.762615:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505180544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 410us (1193us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302487.762624:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789302487.762946:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505180544:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789302487.762986:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789302487.762997:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1158a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302487.763009:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1158a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302487.915503:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302487.915556:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302487.915604:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302487.915638:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302487.915674:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484180736 00000100:00100000:3.0:1789302487.915687:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484180736 00000100:00100000:2.0:1789302487.915988:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484181120 00000100:00100000:2.0:1789302487.915994:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484181120 00000100:00100000:2.0:1789302487.916068:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484180992 00000100:00100000:2.0:1789302487.916072:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484180992 00000100:00100000:2.0:1789302487.916094:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:2.0:1789302487.916107:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484181120:12345-192.168.203.42@tcp:400: 00000100:00100000:2.0:1789302487.916199:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484181120:12345-192.168.203.42@tcp:400: Request processed in 94us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.916207:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:2.0:1789302487.916237:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:2.0:1789302487.916246:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484180992:12345-192.168.203.42@tcp:400: 00000100:00100000:2.0:1789302487.916272:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484180992:12345-192.168.203.42@tcp:400: Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.916334:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00080000:2.0:1789302487.916494:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302487.916499:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302487.916578:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 164 00000100:00100000:2.0:1789302487.916586:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:2353:x1876219484180736:12345-192.168.203.42@tcp:400: 00000100:00100000:2.0:1789302487.916618:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:2353:x1876219484180736:12345-192.168.203.42@tcp:400: Request processed in 33us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302487.916624:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 164 00000100:00100000:0.0:1789302487.916752:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484180864 00000100:00100000:0.0:1789302487.916758:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484180864 00000100:00100000:0.0:1789302487.916854:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:0.0:1789302487.916865:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484180864:12345-192.168.203.42@tcp:400: 00000100:00100000:0.0:1789302487.916913:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484180864:12345-192.168.203.42@tcp:400: Request processed in 52us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302487.916920:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00080000:2.0:1789302487.918195:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789302488.144108:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302489.165692:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302490.189709:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302491.215088:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302491.533846:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505180672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302491.533957:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302491.534263:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505180672 00000100:00100000:0.0:1789302491.534276:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505180672 00000100:00100000:0.0:1789302491.534393:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302491.534406:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505180672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302491.534455:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302491.534515:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505180672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302491.534523:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789302491.534628:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c394000 x1876219505180672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302491.534651:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505180672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302491.534722:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302492.045960:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505180800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302492.046062:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302492.047074:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505180800 00000100:00100000:3.0:1789302492.047100:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505180800 00000100:00100000:3.0:1789302492.047195:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789302492.047210:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505180800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302492.047278:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302492.047401:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505180800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 195us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302492.047409:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789302492.047739:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c397800 x1876219505180800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302492.047764:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505180800:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789302492.048756:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302492.048917:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505181056:0@lo:400:kworker.0 00000100:00100000:2.0:1789302492.049002:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302492.049045:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302492.049050:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505181184:0@lo:400:kworker.0 00000100:00100000:2.0:1789302492.049074:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302492.049341:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505181056 00000100:00100000:2.0:1789302492.049350:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505181056 00000100:00100000:2.0:1789302492.049403:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505181184 00000100:00100000:2.0:1789302492.049406:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505181184 00000100:00100000:2.0:1789302492.049439:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302492.049449:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505181056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302492.050052:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789302492.050069:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505181184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302492.050166:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505181184:12345-0@lo:400:kworker.0 Request processed in 103us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302492.050173:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789302492.050211:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505181312:0@lo:400:kworker.0 00000100:00100000:1.0:1789302492.050249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302492.050277:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789302492.050307:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505180928:0@lo:400:kworker.0 00000100:00100000:1.0:1789302492.050338:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302492.050368:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505181440:0@lo:400:kworker.0 00000100:00100000:1.0:1789302492.050391:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302492.050418:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505181312 00000100:00100000:1.0:1789302492.050424:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505181312 00000100:00100000:2.0:1789302492.051024:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505181056:12345-0@lo:400:kworker.0 Request processed in 1576us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302492.051034:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302492.051055:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505181440 00000100:00100000:0.0:1789302492.051201:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505180928 00000100:00100000:0.0:1789302492.051207:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505180928 00000100:00100000:0.0:1789302492.051245:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789302492.051254:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505180928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302492.051327:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505180928:12345-0@lo:400:kworker.0 Request processed in 75us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302492.051334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789302492.051401:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505181184:0@lo:400:kworker.0 00000100:00100000:0.0:1789302492.051415:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505181056:0@lo:400:kworker.0 00000100:00100000:0.0:1789302492.051450:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505180928:0@lo:400:kworker.0 00000100:00080000:3.0:1789302492.051586:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302492.052185:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302492.052208:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505181312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302492.052314:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505181312:12345-0@lo:400:kworker.0 Request processed in 116us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302492.052360:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505181440 00000100:00100000:2.0:1789302492.052422:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302492.052430:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505181440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302492.052484:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505181440:12345-0@lo:400:kworker.0 Request processed in 56us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302492.052491:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302492.052585:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505181440:0@lo:400:kworker.0 00010000:00080000:2.0:1789302492.052600:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c395880 x1876219505181312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302492.052622:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505181312:0@lo:400:kworker.0 00000100:00080000:3.0:1789302492.054169:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302492.062051:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789302492.237801:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302492.526968:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302492.529618:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484181248 00000100:00100000:3.0:1789302492.529641:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484181248 00000100:00100000:3.0:1789302492.529982:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00100000:3.0:1789302492.529996:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:5594:x1876219484181248:12345-192.168.203.42@tcp:101: 00010000:00010000:3.0:1789302492.530020:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302492.530053:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba7400/0x20be524657f11591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b358e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302492.530089:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7400/0x20be524657f11591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b358e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302492.530103:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba7400/0x20be524657f11591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b358e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302492.530113:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7400, rc 0) 00000100:00100000:3.0:1789302492.530200:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5594:x1876219484181248:12345-192.168.203.42@tcp:101: Request processed in 207us (3247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302492.530228:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00100000:1.0:1789302492.542197:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302492.542310:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484181376 00000100:00100000:0.0:1789302492.542323:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484181376 00000100:00100000:0.0:1789302492.542394:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 167 00000100:00100000:0.0:1789302492.542407:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5594:x1876219484181376:12345-192.168.203.42@tcp:501: 00000100:00100000:0.0:1789302492.542955:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5594:x1876219484181376:12345-192.168.203.42@tcp:501: Request processed in 548us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302492.542965:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 167 00000100:00100000:2.0:1789302492.546988:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302492.547348:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484181504 00000100:00100000:3.0:1789302492.547794:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484181504 00000100:00100000:3.0:1789302492.547924:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 168 00000100:00100000:3.0:1789302492.547936:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5594:x1876219484181504:12345-192.168.203.42@tcp:503: 00000100:00100000:3.0:1789302492.548258:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5594:x1876219484181504:12345-192.168.203.42@tcp:503: Request processed in 322us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302492.548267:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 168 00000100:00100000:2.0:1789302492.553626:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302492.553798:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484181632 00000100:00100000:0.0:1789302492.553813:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484181632 00000100:00100000:0.0:1789302492.553929:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 169 00000100:00100000:0.0:1789302492.553942:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:6092:x1876219484181632:12345-192.168.203.42@tcp:502: 00000100:00100000:0.0:1789302492.554333:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:6092:x1876219484181632:12345-192.168.203.42@tcp:502: Request processed in 393us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302492.554341:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 169 00000100:00100000:2.0:1789302492.557583:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302492.557675:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484181760 00000100:00100000:0.0:1789302492.557747:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484181760 00000100:00100000:0.0:1789302492.557824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:0.0:1789302492.557836:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:6092:x1876219484181760:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302492.558679:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:6092:x1876219484181760:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 842us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302492.558703:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:3.0:1789302492.566464:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302492.567477:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484181888 00000100:00100000:2.0:1789302492.567494:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484181888 00000100:00100000:2.0:1789302492.567644:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:2.0:1789302492.567657:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5594:x1876219484181888:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302492.567689:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302492.567716:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abf200/0x20be524657f11598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3595 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302492.567755:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abf200/0x20be524657f11598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3595 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302492.567768:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abf200/0x20be524657f11598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3595 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302492.567808:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abf200, rc 0) 00000100:00100000:2.0:1789302492.568341:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5594:x1876219484181888:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 684us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302492.568349:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:0.0:1789302492.576385:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302492.576511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484182016 00000100:00100000:3.0:1789302492.576524:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484182016 00000100:00100000:3.0:1789302492.576591:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 172 00000100:00100000:3.0:1789302492.576603:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5594:x1876219484182016:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302492.577971:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5594:x1876219484182016:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 1359us (1588us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302492.577988:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 172 00000100:00100000:3.0:1789302493.035737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302493.035803:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302493.035849:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484182272 00000100:00100000:0.0:1789302493.035863:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484182272 00000100:00100000:3.0:1789302493.036043:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302493.036220:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484182400 00000100:00100000:0.0:1789302493.036225:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484182400 00000100:00100000:0.0:1789302493.036253:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:0.0:1789302493.036265:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484182272:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302493.036394:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484182272:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 131us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302493.036403:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:0.0:1789302493.036425:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:0.0:1789302493.036431:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484182400:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302493.036458:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484182400:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302493.036465:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00080000:2.0:1789302493.037017:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302493.037023:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302493.037039:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484182144 00000100:00100000:2.0:1789302493.037046:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484182144 00000100:00100000:2.0:1789302493.037094:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:2.0:1789302493.037102:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484182144:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302493.037143:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484182144:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 43us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302493.037149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00080000:2.0:1789302493.037170:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789302493.261563:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789302493.732246:0:8516:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8a495f70 20000000:00000080:2.0:1789302493.732268:0:8516:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6935f98800 uarg=0000000000000000 20000000:01000000:2.0:1789302493.732617:0:8516:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789302493.732684:0:8516:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789302493.732690:0:8516:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789302493.735068:0:8517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789302493.735619:0:8516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789302493.743234:0:8516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789302493.743344:0:8516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789302493.743411:0:8516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789302493.743446:0:8516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789302493.743472:0:8516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.743495:0:8516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6900031c00/0x20be524657f11314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1130d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.743950:0:8516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1136f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.743958:0:8516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1143a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.743968:0:8516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.743977:0:8516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.744032:0:8516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.744069:0:8516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 9 pid: 5840 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302493.744089:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1876219505181568:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302493.744314:0:8516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1143a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.744325:0:8516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1143a expref: 18 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302493.744338:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1876219505181696:0@lo:104: 00000100:00100000:1.0:1789302493.744400:0:8516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302493.744459:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505181696 00010000:00010000:1.0:1789302493.744466:0:8516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1136f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302493.744471:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505181696 00010000:00010000:1.0:1789302493.744479:0:8516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1136f expref: 18 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302493.744490:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bea9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1876219505181824:0@lo:104: 00000100:00100000:0.0:1789302493.744543:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789302493.744554:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:8516:x1876219505181696:12345-0@lo:104: 00010000:00010000:0.0:1789302493.744570:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302493.744652:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302493.744666:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:8516:x1876219505181696:12345-0@lo:104: Request processed in 114us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302493.744674:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789302493.744705:0:8516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302493.744726:0:8516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6900031c00/0x20be524657f11314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1130d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.744735:0:8516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6900031c00/0x20be524657f11314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1130d expref: 18 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302493.744744:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1876219505181952:0@lo:104: 00000100:00100000:1.0:1789302493.744776:0:8516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302493.744978:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1876219505181696:0@lo:104: 00000100:00100000:2.0:1789302493.745086:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789302493.745125:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302493.745135:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505181824 00000100:00100000:2.0:1789302493.745140:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505181952 00000100:00100000:0.0:1789302493.745142:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505181824 00000100:00100000:2.0:1789302493.745146:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505181952 00000100:00100000:0.0:1789302493.745165:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789302493.745174:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936aff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+4:8516:x1876219505181824:12345-0@lo:104: 00010000:00010000:0.0:1789302493.745185:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302493.745328:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1876219505181824:0@lo:104: 00010000:00010000:0.0:1789302493.749129:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789302493.749156:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936aff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+4:8516:x1876219505181824:12345-0@lo:104: Request processed in 3975us (4443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302493.749242:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789302493.749410:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302493.749460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484182528 00000100:00100000:3.0:1789302493.749472:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484182528 00010000:00010000:3.0:1789302493.749527:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 10 pid: 5840 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302493.749562:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:3.0:1789302493.749592:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2351:x1876219484182528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302493.749610:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302493.749617:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 10 pid: 5840 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302493.749648:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 10 pid: 5840 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302493.749674:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302493.749739:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2351:x1876219484182528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 149us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302493.749746:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:0.0:1789302493.749929:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789302493.749942:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:8516:x1876219505181952:12345-0@lo:104: 00010000:00010000:0.0:1789302493.749956:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.752577:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789302493.752598:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.752639:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9600 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302493.752644:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.752657:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302493.752665:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302493.752671:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789302493.754433:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754447:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302493.754484:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754492:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c9600/0x20be524657f1143a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11441 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754518:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302493.754523:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754529:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7200 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302493.754533:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754560:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302493.754567:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302493.754572:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789302493.754587:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754592:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302493.754598:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754605:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1136f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11376 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754614:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302493.754617:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754622:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302493.754625:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754632:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302493.754638:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302493.754649:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789302493.754663:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754669:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302493.754699:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754706:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c9a00/0x20be524657f1130d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f11314 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.754722:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302493.754724:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302493.754727:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302493.754785:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505182208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302493.757879:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302493.758587:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505182336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302493.758874:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302493.758947:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505182336 00000100:00100000:2.0:1789302493.758957:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505182336 00010000:00010000:2.0:1789302493.759006:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6900031c00/0x20be524657f11314 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1130d expref: 19 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302493.759047:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302493.759057:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505182336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302493.759076:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302493.759083:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6900031c00/0x20be524657f11314 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1130d expref: 19 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.759087:0:8516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abfc00/0x20be524657f114fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b355d expref: 9 pid: 5840 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759094:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6900031c00/0x20be524657f11314 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1130d expref: 19 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302493.759105:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bea8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1876219505181568:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302493.759128:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8516:1876219505181952:0@lo:104: 00010000:00010000:2.0:1789302493.759133:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900031c00/0x20be524657f11314 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1130d expref: 19 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759147:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302493.759161:0:8516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302493.759194:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+18:3305:x1876219505182336:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302493.759202:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302493.759257:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302493.759306:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302493.759318:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505182080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302493.759343:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302493.759365:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505182208 00000100:00100000:2.0:1789302493.759368:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505182208 00010000:00010000:2.0:1789302493.759384:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1136f expref: 18 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302493.759402:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505182080 00000100:00100000:2.0:1789302493.759405:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505182080 00010000:00010000:2.0:1789302493.759416:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1143a expref: 19 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302493.759432:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789302493.759438:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505182208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302493.759445:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302493.759449:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1136f expref: 19 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759457:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1136f expref: 19 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759474:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abe800/0x20be524657f11376 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1136f expref: 19 pid: 5839 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759485:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302493.759508:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+18:3304:x1876219505182208:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302493.759514:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789302493.759528:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302493.759535:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+17:3304:x1876219505182080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302493.759542:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302493.759546:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1143a expref: 17 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759557:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1143a expref: 17 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759567:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba6600/0x20be524657f11441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1143a expref: 17 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759578:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759587:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759603:0:6712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759611:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759624:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759632:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759639:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302493.759644:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759653:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759665:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.759690:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302493.759715:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789302493.759716:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+16:3304:x1876219505182080:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302493.759727:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789302493.759733:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:8516:x1876219505181952:12345-0@lo:104: Request processed in 9789us (14603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302493.759745:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789302493.759780:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505182080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302493.759792:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505182208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302493.759882:0:8516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.759891:0:8516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302493.759897:0:8516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c9800/0x20be524657f1159f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302493.760897:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302493.761757:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505182336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302493.836620:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302493.836686:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484182656 00000100:00100000:2.0:1789302493.836699:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484182656 00000100:00100000:2.0:1789302493.836781:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 173 00000100:00100000:2.0:1789302493.836794:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:5594:x1876219484182656:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302493.836816:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302493.836852:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b359c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.836888:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.836903:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302493.836913:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abfc00, rc 0) 00000100:00100000:2.0:1789302493.836987:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5594:x1876219484182656:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 196us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302493.836996:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 173 00000100:00100000:0.0:1789302493.850034:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302493.850970:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484182784 00000100:00100000:3.0:1789302493.850988:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484182784 00000100:00100000:3.0:1789302493.851073:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 174 00000100:00100000:3.0:1789302493.851085:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5594:x1876219484182784:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302493.851626:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5594:x1876219484182784:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 540us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302493.851637:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 174 00000100:00100000:2.0:1789302493.856185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302493.856894:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484182912 00000100:00100000:0.0:1789302493.856911:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484182912 00000100:00100000:0.0:1789302493.856991:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 175 00000100:00100000:0.0:1789302493.857002:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5594:x1876219484182912:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302493.858042:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:5594:x1876219484182912:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 1032us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302493.858055:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 175 00000100:00100000:0.0:1789302493.866133:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302493.867672:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484183040 00000100:00100000:2.0:1789302493.867693:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484183040 00000100:00100000:2.0:1789302493.867786:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 176 00000100:00100000:2.0:1789302493.867800:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:6115:x1876219484183040:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302493.868130:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:6115:x1876219484183040:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 332us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302493.868139:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 176 00000100:00100000:2.0:1789302493.884446:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302493.884653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484183168 00000100:00100000:3.0:1789302493.884667:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484183168 00000100:00100000:3.0:1789302493.884734:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 177 00000100:00100000:3.0:1789302493.884746:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:6115:x1876219484183168:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302493.885064:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:6115:x1876219484183168:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 319us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302493.885073:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 177 00010000:00010000:2.0:1789302494.285576:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302495.310952:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789302495.375536:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302495.375546:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6936077800 from 4 10000000:01000000:0.0:1789302495.375553:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302495.375616:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302495.375630:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302495.375643:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302495.375676:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505182464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302495.375784:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302495.375928:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690873b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302495.381275:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505182464 00000100:00100000:2.0:1789302495.381308:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505182464 00000100:00100000:2.0:1789302495.381445:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789302495.381458:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505182464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302495.381482:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302495.381535:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f115ad expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302495.381570:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f115ad expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302495.381583:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f115ad expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302495.381593:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abf000, rc 0) 00000100:00100000:2.0:1789302495.381767:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505182464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 301us (5972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302495.381774:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789302495.382020:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505182464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302495.382046:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302495.382057:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302495.382144:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505182592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302495.382189:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302495.382233:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690873b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302495.382552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505182592 00000100:00100000:1.0:1789302495.382559:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505182592 00000100:00100000:1.0:1789302495.382602:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789302495.382612:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505182592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302495.382956:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505182592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 345us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302495.382964:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789302495.383035:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505182592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302495.383070:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505182720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302495.383126:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302495.383152:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690873b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302495.383267:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505182720 00000100:00100000:3.0:1789302495.383272:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505182720 00000100:00100000:3.0:1789302495.383342:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789302495.383394:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505182720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.383580:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505182720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302495.383589:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789302495.386243:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505182720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.388944:0:8584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8584:1876219505182848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302495.389047:0:8584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302495.389136:0:8584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eaba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302495.397280:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505182848 00000100:00100000:1.0:1789302495.397315:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505182848 00000100:00100000:1.0:1789302495.397488:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789302495.397504:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:8584:x1876219505182848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302495.397989:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:8584:x1876219505182848:12345-0@lo:502:llog_process_th.0 Request processed in 487us (8939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302495.398002:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789302495.404590:0:8584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8584:1876219505182848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302495.404653:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302495.404668:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302495.404671:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789302495.404681:0:8584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6936077800 00000020:00000080:3.0:1789302495.404684:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789302495.404891:0:8584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8584:1876219505182976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302495.404980:0:8584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302495.405025:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505182976 00000100:00100000:3.0:1789302495.405033:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505182976 00000100:00100000:3.0:1789302495.405087:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789302495.405096:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:8584:x1876219505182976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302495.405693:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:8584:x1876219505182976:12345-0@lo:502:llog_process_th.0 Request processed in 596us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302495.405702:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789302495.405774:0:8584:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eaba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302495.405792:0:8584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8584:1876219505182976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302495.405814:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302495.405820:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302495.405822:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789302495.405826:0:8584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789302495.406108:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789302495.406134:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302495.406147:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302495.406223:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302495.406236:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302495.406239:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6902e2c800 from 4 10000000:01000000:1.0:1789302495.406242:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302495.406307:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302495.406316:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302495.406326:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302495.406347:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302495.406393:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302495.406419:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302495.406776:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505183104 00000100:00100000:3.0:1789302495.406784:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505183104 00000100:00100000:3.0:1789302495.406820:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789302495.406827:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505183104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302495.406841:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302495.406856:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f115bb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.406881:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f115bb expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.406893:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f115bb expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.406902:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6000, rc 0) 00000100:00100000:3.0:1789302495.406936:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505183104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302495.406942:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789302495.406979:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302495.406999:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.407009:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302495.407056:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.407078:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302495.407090:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302495.407100:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505183232 00000100:00100000:3.0:1789302495.407104:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505183232 00000100:00100000:3.0:1789302495.407123:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789302495.407129:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505183232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.410684:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505183232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3540us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302495.410702:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789302495.410975:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.411041:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.411096:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302495.411143:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302495.412652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505183360 00000100:00100000:1.0:1789302495.412668:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505183360 00000100:00100000:1.0:1789302495.412746:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789302495.412767:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505183360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302495.413039:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505183360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 282us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302495.413047:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789302495.414611:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302495.421502:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8586:1876219505183488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302495.421608:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302495.421677:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505183488 00000100:00100000:1.0:1789302495.421686:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505183488 00000100:00100000:1.0:1789302495.421751:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789302495.421770:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:8586:x1876219505183488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302495.422402:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:8586:x1876219505183488:12345-0@lo:502:llog_process_th.0 Request processed in 630us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302495.422413:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789302495.423981:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302495.424055:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8586:1876219505183488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302495.424536:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302495.424550:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302495.424553:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789302495.424565:0:8586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6902e2c800 00000020:00000080:1.0:1789302495.424567:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789302495.425548:0:8586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8586:1876219505183616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302495.425647:0:8586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302495.426196:0:8586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302495.426692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505183616 00000100:00100000:0.0:1789302495.426702:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505183616 00000100:00100000:0.0:1789302495.426773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789302495.426784:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:8586:x1876219505183616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302495.427702:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:8586:x1876219505183616:12345-0@lo:502:llog_process_th.0 Request processed in 914us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302495.427714:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789302495.427828:0:8586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8586:1876219505183616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302495.427876:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302495.427892:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302495.427895:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789302495.427908:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789302495.428276:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789302495.428447:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302495.428467:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302495.428481:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302495.428500:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302495.428502:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6905909800 from 4 10000000:01000000:0.0:1789302495.428506:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302495.428558:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302495.428568:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302495.428592:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302495.428624:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302495.428685:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302495.428769:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690873b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302495.428805:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505183744 00000100:00100000:3.0:1789302495.428813:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505183744 00000100:00100000:3.0:1789302495.428891:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789302495.428901:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505183744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302495.428915:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302495.428930:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f115c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.428959:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f115c9 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.428971:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f115c9 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.428981:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:3.0:1789302495.429267:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505183744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 368us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302495.429274:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789302495.429440:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302495.429456:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.429465:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302495.429527:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.429554:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302495.429626:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302495.429660:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505183872 00000100:00100000:0.0:1789302495.429665:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505183872 00000100:00100000:0.0:1789302495.429725:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789302495.429733:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505183872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302495.430096:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505183872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302495.430104:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789302495.430340:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505183872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.430374:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505184000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.430413:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302495.430429:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302495.430443:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505184000 00000100:00100000:3.0:1789302495.430447:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505184000 00000100:00100000:3.0:1789302495.430473:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789302495.430479:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505184000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.430655:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505184000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302495.430663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789302495.430701:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505184000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302495.430914:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8587:1876219505184128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302495.430950:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302495.430967:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505184128 00000100:00100000:3.0:1789302495.430971:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505184128 00000100:00100000:3.0:1789302495.430990:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789302495.430995:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:8587:x1876219505184128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302495.431133:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:8587:x1876219505184128:12345-0@lo:502:llog_process_th.0 Request processed in 136us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302495.431140:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789302495.431184:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302495.431206:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8587:1876219505184128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302495.431227:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302495.431246:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302495.431249:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789302495.431256:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6905909800 00000020:00000080:3.0:1789302495.431258:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789302495.431391:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8587:1876219505184256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302495.431424:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302495.431441:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505184256 00000100:00100000:3.0:1789302495.431445:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505184256 00000100:00100000:3.0:1789302495.431465:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789302495.431470:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:8587:x1876219505184256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302495.431571:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:8587:x1876219505184256:12345-0@lo:502:llog_process_th.0 Request processed in 100us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302495.431578:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789302495.431613:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302495.431623:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:8587:1876219505184256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302495.431639:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302495.431643:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302495.431644:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789302495.431648:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789302495.431699:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789302495.431723:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789302495.431733:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302495.431745:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302496.333561:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302496.654474:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302496.654507:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505184384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302496.654617:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302496.654782:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505184384 00000100:00100000:1.0:1789302496.654794:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505184384 00000100:00100000:1.0:1789302496.654874:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789302496.654887:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505184384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302496.654934:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302496.654990:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505184384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302496.654998:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789302496.655123:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302496.655256:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c395180 x1876219505184384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302496.655280:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505184384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302497.165656:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505184768:0@lo:400:kworker.0 00000100:00100000:1.0:1789302497.165753:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302497.165959:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302497.165966:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505184896:0@lo:400:kworker.0 00000100:00100000:1.0:1789302497.166000:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302497.166144:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505184896 00000100:00100000:0.0:1789302497.166154:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505184896 00000100:00100000:0.0:1789302497.166231:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302497.166242:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505184896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302497.166347:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505184896:12345-0@lo:400:kworker.0 Request processed in 107us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302497.166355:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789302497.166411:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903e35c00 x1876219505184896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302497.166428:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505184896:0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.166852:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505184512:0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.166898:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302497.166944:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505185024:0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.166972:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302497.166996:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789302497.167003:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505184640:0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.167027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302497.167047:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505185152:0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.167071:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302497.167115:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505184768 00000100:00100000:2.0:1789302497.167122:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505184768 00000100:00100000:2.0:1789302497.167170:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505185024 00000100:00100000:2.0:1789302497.167173:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505185024 00000100:00100000:2.0:1789302497.167186:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505184640 00000100:00100000:2.0:1789302497.167188:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505184640 00000100:00100000:2.0:1789302497.167218:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302497.167226:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505184768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.167279:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505184768:12345-0@lo:400:kworker.0 Request processed in 54us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302497.167313:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302497.167329:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789302497.167336:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505185024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.167370:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505185024:12345-0@lo:400:kworker.0 Request processed in 35us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302497.167376:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789302497.167387:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789302497.167393:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505184640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.167425:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505184640:12345-0@lo:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302497.167430:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789302497.167457:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505185152 00000100:00100000:2.0:1789302497.167461:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505185152 00000100:00100000:2.0:1789302497.167489:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789302497.167495:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505185152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.167526:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505185152:12345-0@lo:400:kworker.0 Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302497.167531:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789302497.167547:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302497.167552:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302497.167585:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505184640:0@lo:400:kworker.0 00010000:00080000:2.0:1789302497.167609:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362aad80 x1876219505185152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302497.167630:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505185152:0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.167643:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505185024:0@lo:400:kworker.0 00000100:00100000:2.0:1789302497.167682:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505184768:0@lo:400:kworker.0 00000100:00100000:0.0:1789302497.168760:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505184512 00000100:00100000:0.0:1789302497.168780:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505184512 00000100:00100000:0.0:1789302497.168845:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789302497.168854:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505184512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302497.168934:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505184512:12345-0@lo:400:kworker.0 Request processed in 82us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302497.168942:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789302497.170979:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302497.171009:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505185280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302497.171815:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505184512:0@lo:400:kworker.0 00000100:00100000:0.0:1789302497.172346:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302497.172417:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505185280 00000100:00100000:0.0:1789302497.172426:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505185280 00000100:00100000:0.0:1789302497.172482:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789302497.172491:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505185280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302497.172535:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302497.173429:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505185280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302497.173444:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789302497.173518:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362aed80 x1876219505185280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302497.173543:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505185280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789302497.359647:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302498.159246:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302498.159341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302498.159374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302498.159415:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302498.159459:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484183424 00000100:00100000:0.0:1789302498.159472:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484183424 00000100:00100000:0.0:1789302498.159563:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:0.0:1789302498.159576:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484183424:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302498.159674:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484183424:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 102us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302498.159682:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:0.0:1789302498.159714:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484183680 00000100:00100000:0.0:1789302498.159718:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484183680 00000100:00100000:0.0:1789302498.159757:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484183552 00000100:00100000:0.0:1789302498.159761:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484183552 00000100:00100000:0.0:1789302498.159777:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789302498.159783:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484183680:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302498.159808:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484183680:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302498.159814:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789302498.159824:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789302498.159830:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484183552:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302498.159848:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484183552:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 18us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302498.159853:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789302498.159870:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484183296 00000100:00100000:0.0:1789302498.159874:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484183296 00000100:00100000:0.0:1789302498.159897:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 194 00000100:00100000:0.0:1789302498.159903:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2354:x1876219484183296:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302498.159928:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2354:x1876219484183296:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302498.159944:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 194 00000100:00080000:1.0:1789302498.159984:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302498.159990:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302498.159993:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789302498.386609:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302499.405991:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302500.433503:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302500.821200:0:8815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789302501.453478:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302501.782637:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302501.782661:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505185408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302501.782739:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302501.785196:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505185408 00000100:00100000:2.0:1789302501.785219:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505185408 00000100:00100000:2.0:1789302501.785320:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302501.785331:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505185408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302501.785370:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302501.785445:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505185408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302501.785457:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789302501.785502:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c397b80 x1876219505185408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302501.785522:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505185408:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789302501.785721:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302502.286906:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505185920:0@lo:400:kworker.0 00000100:00100000:1.0:1789302502.286983:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302502.287054:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302502.287060:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505185792:0@lo:400:kworker.0 00000100:00100000:1.0:1789302502.287088:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302502.287122:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505185920 00000100:00100000:1.0:1789302502.287142:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505185920 00000100:00100000:1.0:1789302502.287212:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789302502.287220:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505185920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302502.287272:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505185920:12345-0@lo:400:kworker.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302502.287279:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302502.287522:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505185536:0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.287560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302502.287592:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505186048:0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.287615:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302502.287635:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789302502.287641:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505185664:0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.287661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302502.287687:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505186176:0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.287723:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302502.287750:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505185536 00000100:00100000:2.0:1789302502.287754:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505185536 00000100:00100000:2.0:1789302502.287785:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789302502.287791:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505185536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.287825:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505185536:12345-0@lo:400:kworker.0 Request processed in 35us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302502.287832:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789302502.287859:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505185792 00000100:00100000:2.0:1789302502.287863:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505185792 00000100:00100000:2.0:1789302502.287893:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505186048 00000100:00100000:2.0:1789302502.287896:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505186048 00000100:00100000:2.0:1789302502.287908:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505185664 00000100:00100000:2.0:1789302502.287910:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505185664 00000100:00100000:2.0:1789302502.287922:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789302502.287929:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505185792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.287958:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505185792:12345-0@lo:400:kworker.0 Request processed in 30us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302502.287964:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789302502.287974:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302502.287980:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505186048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.288002:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505186048:12345-0@lo:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302502.288008:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302502.288017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302502.288023:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505185664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.288060:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505185664:12345-0@lo:400:kworker.0 Request processed in 37us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302502.288065:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789302502.288089:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302502.288119:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505185664:0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.288143:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505185536:0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.288152:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505186048:0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.288196:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505186176 00000100:00100000:2.0:1789302502.288200:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505186176 00000100:00100000:2.0:1789302502.288226:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302502.288232:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505186176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.288265:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505186176:12345-0@lo:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302502.288272:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789302502.288318:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789302502.288337:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362ab800 x1876219505186176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302502.288348:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505186176:0@lo:400:kworker.0 00000100:00100000:2.0:1789302502.288377:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505185792:0@lo:400:kworker.0 00010000:00080000:2.0:1789302502.288388:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362a8e00 x1876219505185920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302502.288397:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505185920:0@lo:400:kworker.0 00000100:00100000:3.0:1789302502.290101:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302502.290119:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505186304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302502.290179:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302502.290267:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505186304 00000100:00100000:1.0:1789302502.290274:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505186304 00000100:00100000:1.0:1789302502.290347:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789302502.290356:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505186304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302502.290389:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302502.290439:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505186304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302502.290445:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789302502.290622:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362a8700 x1876219505186304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302502.290642:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505186304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789302502.477604:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302503.281420:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302503.281484:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302503.281625:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484183808 00000100:00100000:0.0:1789302503.281638:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484183808 00000100:00100000:0.0:1789302503.281721:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 196 00000100:00100000:0.0:1789302503.281734:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2352:x1876219484183808:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302503.281824:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2352:x1876219484183808:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 92us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302503.281832:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 196 00000100:00100000:3.0:1789302503.284021:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484183936 00000100:00100000:3.0:1789302503.284039:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484183936 00000100:00100000:3.0:1789302503.284125:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:3.0:1789302503.284138:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484183936:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302503.284224:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484183936:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 89us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302503.284232:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00080000:3.0:1789302503.284949:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302503.288615:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302503.288676:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484184064 00000100:00100000:0.0:1789302503.288683:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302503.288690:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484184064 00000100:00100000:0.0:1789302503.288725:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484184192 00000100:00100000:0.0:1789302503.288732:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484184192 00000100:00100000:3.0:1789302503.288792:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:3.0:1789302503.288804:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2350:x1876219484184064:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:3.0:1789302503.288847:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f1150c 00000100:00080000:3.0:1789302503.288945:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9a6805801800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789302503.288994:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1789302503.289367:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789302503.289384:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302503.289390:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302503.289442:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+2:2350:x1876219484184064:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 639us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302503.289451:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:0.0:1789302503.290063:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:0.0:1789302503.290078:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2350:x1876219484184192:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:0.0:1789302503.290113:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11513 00000100:00080000:0.0:1789302503.290123:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a6805807000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789302503.290196:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789302503.291414:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+2:2350:x1876219484184192:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 1334us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302503.291425:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00010000:00010000:2.0:1789302503.294325:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789302503.403687:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:3.0:1789302503.403697:0:6722:0:(genops.c:885:class_export_put()) final put ffff9a6805801000/ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:1.0:1789302503.403821:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6805801000/ace2f696-3715-4928-b36c-02db3411d1a3 for lustre-OST0000 00000020:00000080:1.0:1789302503.403884:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6805801800 for lustre-OST0000 00010000:00010000:0.0:1789302503.502605:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302504.526070:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302505.554482:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302506.378169:0:9061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing yml_node 00010000:00010000:0.0:1789302506.573893:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302506.895117:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302506.895138:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505186432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302506.895210:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302506.895774:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505186432 00000100:00100000:1.0:1789302506.895784:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505186432 00000100:00100000:1.0:1789302506.895848:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789302506.895860:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505186432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302506.895895:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302506.895943:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505186432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302506.895949:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789302506.895995:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c397800 x1876219505186432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302506.896029:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505186432:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302506.896224:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302507.407239:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505186560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302507.407342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302507.408000:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505186560 00000100:00100000:1.0:1789302507.408010:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505186560 00000100:00100000:1.0:1789302507.408072:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302507.408083:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505186560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302507.408118:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302507.408170:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505186560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302507.408177:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789302507.408309:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789302507.408342:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c50f800 x1876219505186560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302507.408482:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505186560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302507.409126:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505186688:0@lo:400:kworker.0 00000100:00100000:3.0:1789302507.409178:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302507.409342:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505186816:0@lo:400:kworker.0 00000100:00100000:1.0:1789302507.409383:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302507.409406:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302507.409413:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505186944:0@lo:400:kworker.0 00000100:00100000:1.0:1789302507.409435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302507.409463:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505186816 00000100:00100000:1.0:1789302507.409468:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505186816 00000100:00100000:1.0:1789302507.409501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505186944 00000100:00100000:1.0:1789302507.409503:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505186944 00000100:00100000:1.0:1789302507.409528:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302507.409535:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505186816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302507.409601:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505186816:12345-0@lo:400:kworker.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302507.409608:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789302507.409624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302507.409630:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505186944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302507.409687:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505186944:12345-0@lo:400:kworker.0 Request processed in 57us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302507.409693:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302507.409726:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505186944:0@lo:400:kworker.0 00000100:00100000:1.0:1789302507.409737:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505186816:0@lo:400:kworker.0 00000100:00100000:3.0:1789302507.410031:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302507.410039:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505187072:0@lo:400:kworker.0 00000100:00100000:3.0:1789302507.410068:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302507.410104:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505186688 00000100:00100000:3.0:1789302507.410108:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505186688 00000100:00100000:3.0:1789302507.410139:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789302507.410146:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505186688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302507.410190:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505186688:12345-0@lo:400:kworker.0 Request processed in 45us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302507.410197:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789302507.410312:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505187072 00000100:00100000:3.0:1789302507.410316:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505187072 00000100:00100000:3.0:1789302507.410344:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789302507.410444:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505187072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302507.410475:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505187072:12345-0@lo:400:kworker.0 Request processed in 126us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302507.410481:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789302507.410496:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302507.410518:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505187072:0@lo:400:kworker.0 00000100:00100000:3.0:1789302507.410526:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505186688:0@lo:400:kworker.0 00010000:00010000:2.0:1789302507.597413:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789302508.052982:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:3.0:1789302508.052992:0:7652:0:(genops.c:885:class_export_put()) final put ffff9a6805805000/ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:2.0:1789302508.053887:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6805805000/ace2f696-3715-4928-b36c-02db3411d1a3 for lustre-OST0001 00000020:00000080:2.0:1789302508.053932:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6805807000 for lustre-OST0001 00000100:00100000:0.0:1789302508.403384:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302508.403440:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302508.403564:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484184448 00000100:00100000:3.0:1789302508.403574:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484184448 00000100:00100000:3.0:1789302508.403647:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:3.0:1789302508.403657:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484184448:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302508.403736:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484184448:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 80us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302508.403743:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00080000:2.0:1789302508.403994:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302508.408425:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484184320 00000100:00100000:1.0:1789302508.408442:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484184320 00000100:00100000:1.0:1789302508.409015:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 198 00000100:00100000:1.0:1789302508.409029:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2352:x1876219484184320:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302508.409127:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2352:x1876219484184320:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 102us (5685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302508.409135:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 198 00010000:00010000:2.0:1789302508.621446:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302509.646843:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302510.670716:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302510.674144:0:9255:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1789302511.704228:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302512.015610:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505187200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302512.015687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302512.026088:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505187200 00000100:00100000:1.0:1789302512.026103:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505187200 00000100:00100000:1.0:1789302512.026166:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302512.026177:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505187200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302512.026212:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302512.026307:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505187200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (10620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302512.026314:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789302512.027178:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302512.027548:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c394e00 x1876219505187200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302512.027573:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505187200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302512.525557:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505187328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302512.525631:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302512.525692:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505187328 00000100:00100000:2.0:1789302512.525701:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505187328 00000100:00100000:2.0:1789302512.525767:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302512.525777:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505187328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302512.525810:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302512.525866:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505187328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302512.525890:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789302512.525957:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789302512.526083:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c394e00 x1876219505187328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302512.526090:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505187584:0@lo:400:kworker.0 00000100:00100000:1.0:1789302512.526119:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505187328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302512.526137:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505187840:0@lo:400:kworker.0 00000100:00100000:0.0:1789302512.526146:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302512.526213:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505187456:0@lo:400:kworker.0 00000100:00100000:2.0:1789302512.531426:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505187712:0@lo:400:kworker.0 00000100:00100000:1.0:1789302512.531742:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302512.531796:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505187584 00000100:00100000:1.0:1789302512.531804:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505187584 00000100:00100000:1.0:1789302512.531848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505187840 00000100:00100000:1.0:1789302512.531851:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505187840 00000100:00100000:1.0:1789302512.531881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789302512.531889:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505187584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302512.531943:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505187584:12345-0@lo:400:kworker.0 Request processed in 54us (5797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302512.531949:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789302512.531965:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302512.531972:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505187840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302512.531999:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505187840:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302512.532005:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789302512.532034:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302512.534376:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505187584:0@lo:400:kworker.0 00000100:00100000:3.0:1789302512.537332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302512.537333:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505187840:0@lo:400:kworker.0 00000100:00100000:3.0:1789302512.537417:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505187456 00000100:00100000:3.0:1789302512.537424:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505187456 00000100:00100000:3.0:1789302512.537470:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789302512.537478:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505187456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302512.537531:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505187456:12345-0@lo:400:kworker.0 Request processed in 53us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302512.537537:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789302512.537571:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505187456:0@lo:400:kworker.0 00000100:00100000:2.0:1789302512.538725:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302512.538757:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505187712 00000100:00100000:0.0:1789302512.538765:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505187712 00000100:00100000:0.0:1789302512.538835:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789302512.538843:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505187712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302512.538917:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505187712:12345-0@lo:400:kworker.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302512.538925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302512.538945:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505187712:0@lo:400:kworker.0 00000100:00080000:3.0:1789302512.539471:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789302512.718443:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789302513.436059:0:9352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:0.0:1789302513.520277:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302513.520353:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302513.520437:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484184576 00000100:00100000:1.0:1789302513.520449:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484184576 00000100:00100000:1.0:1789302513.520508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 200 00000100:00100000:1.0:1789302513.520533:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2351:x1876219484184576:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302513.520605:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2351:x1876219484184576:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 74us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302513.520612:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 200 00000100:00100000:3.0:1789302513.521604:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484184704 00000100:00100000:3.0:1789302513.521613:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484184704 00000100:00100000:3.0:1789302513.521712:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789302513.521720:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484184704:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302513.521778:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484184704:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 59us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302513.521785:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00080000:0.0:1789302513.530370:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789302513.745994:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302514.770924:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302515.792786:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302516.185625:0:9451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:2.0:1789302516.813783:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302517.133630:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505187968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302517.133869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302517.136304:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505187968 00000100:00100000:1.0:1789302517.136323:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505187968 00000100:00100000:1.0:1789302517.136508:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789302517.136521:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505187968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302517.136584:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302517.136708:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505187968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302517.136716:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789302517.137173:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302517.137581:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c395500 x1876219505187968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302517.137621:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505187968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302517.646530:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505188224:0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.646632:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302517.646707:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789302517.646714:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505188096:0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.646745:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302517.646769:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505188608:0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.646797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302517.646834:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505188352:0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.646860:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302517.646875:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302517.646880:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505188480:0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.646899:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302517.646929:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505188224 00000100:00100000:0.0:1789302517.646939:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505188224 00000100:00100000:0.0:1789302517.646990:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505188352 00000100:00100000:0.0:1789302517.646993:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505188352 00000100:00100000:0.0:1789302517.647020:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505188480 00000100:00100000:0.0:1789302517.647023:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505188480 00000100:00100000:0.0:1789302517.647056:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302517.647066:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505188224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.647128:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505188224:12345-0@lo:400:kworker.0 Request processed in 63us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302517.647135:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302517.647156:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789302517.647162:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505188352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.647192:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505188352:12345-0@lo:400:kworker.0 Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302517.647198:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789302517.647209:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789302517.647215:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505188480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.647239:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505188480:12345-0@lo:400:kworker.0 Request processed in 25us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302517.647244:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789302517.647262:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505188096 00000100:00100000:0.0:1789302517.647274:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505188096 00000100:00100000:0.0:1789302517.647329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789302517.647335:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505188096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.647369:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505188096:12345-0@lo:400:kworker.0 Request processed in 35us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302517.647375:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789302517.647408:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505188608 00000100:00100000:0.0:1789302517.647412:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505188608 00000100:00100000:0.0:1789302517.647448:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789302517.647455:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505188608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.647485:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505188608:12345-0@lo:400:kworker.0 Request processed in 31us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302517.647491:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789302517.647507:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302517.647512:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302517.647546:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505188480:0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.647556:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505188352:0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.647586:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505188096:0@lo:400:kworker.0 00010000:00080000:0.0:1789302517.647598:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903e35880 x1876219505188608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302517.647619:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505188608:0@lo:400:kworker.0 00000100:00100000:0.0:1789302517.647630:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505188224:0@lo:400:kworker.0 00000100:00100000:2.0:1789302517.655134:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302517.655219:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505188736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302517.655914:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302517.657419:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505188736 00000100:00100000:3.0:1789302517.657435:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505188736 00000100:00100000:3.0:1789302517.657507:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302517.657519:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505188736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302517.657578:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302517.657679:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505188736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302517.657687:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789302517.657871:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c397800 x1876219505188736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302517.657895:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505188736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789302517.839716:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789302518.271480:0:9500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 13 08:28:35 EDT 2026 00000100:00100000:0.0:1789302518.638242:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302518.638305:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302518.638614:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484184960 00000100:00100000:1.0:1789302518.638623:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484184960 00000100:00100000:1.0:1789302518.638690:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:1.0:1789302518.638701:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484184960:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302518.638768:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484184960:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 70us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302518.638776:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00080000:0.0:1789302518.638913:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302518.639039:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484184832 00000100:00100000:3.0:1789302518.639044:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484184832 00000100:00100000:3.0:1789302518.639077:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 202 00000100:00100000:3.0:1789302518.639084:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2352:x1876219484184832:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302518.639125:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2352:x1876219484184832:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 41us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302518.639131:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 202 00010000:00010000:1.0:1789302518.864434:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302519.888550:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302520.913261:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302521.937055:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302522.255533:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505188864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302522.255647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302522.261029:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505188864 00000100:00100000:2.0:1789302522.261052:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505188864 00000100:00100000:2.0:1789302522.261155:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302522.261169:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505188864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302522.261219:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302522.261349:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505188864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (5702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302522.261356:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789302522.261584:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302522.261646:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c397800 x1876219505188864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302522.261671:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505188864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302522.766017:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505189376:0@lo:400:kworker.0 00000100:00100000:0.0:1789302522.766126:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302522.766250:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505188992:0@lo:400:kworker.0 00000100:00100000:0.0:1789302522.766389:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505189248:0@lo:400:kworker.0 00000100:00100000:1.0:1789302522.766509:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505189376 00000100:00100000:1.0:1789302522.766529:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505189376 00000100:00100000:2.0:1789302522.766901:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505189120:0@lo:400:kworker.0 00000100:00100000:1.0:1789302522.767811:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302522.767831:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505189376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302522.771480:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302522.771584:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505189504:0@lo:400:kworker.0 00000100:00100000:3.0:1789302522.771788:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302522.771867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505188992 00000100:00100000:3.0:1789302522.771879:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505188992 00000100:00100000:3.0:1789302522.771942:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789302522.771954:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505188992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302522.772112:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302522.772326:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505189248 00000100:00100000:0.0:1789302522.772331:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505189248 00000100:00100000:0.0:1789302522.772380:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789302522.772388:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505189248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302522.772441:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505189248:12345-0@lo:400:kworker.0 Request processed in 54us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302522.772449:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789302522.772475:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302522.772516:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505189248:0@lo:400:kworker.0 00000100:00100000:0.0:1789302522.772597:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505189504 00000100:00100000:0.0:1789302522.772601:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505189504 00000100:00100000:2.0:1789302522.776257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302522.777216:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789302522.777240:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505189504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302522.777348:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505189504:12345-0@lo:400:kworker.0 Request processed in 120us (5559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302522.777378:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789302522.777425:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302522.777442:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505189120 00000100:00100000:0.0:1789302522.777451:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505189120 00000100:00100000:0.0:1789302522.777495:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789302522.777503:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505189120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302522.779814:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505188992:12345-0@lo:400:kworker.0 Request processed in 4011us (4496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302522.779842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789302522.779993:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505189120:12345-0@lo:400:kworker.0 Request processed in 2488us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302522.780004:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789302522.781962:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505188992:0@lo:400:kworker.0 00000100:00100000:1.0:1789302522.782280:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505189376:12345-0@lo:400:kworker.0 Request processed in 14456us (16151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302522.782323:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302522.782384:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505189376:0@lo:400:kworker.0 00010000:00080000:0.0:1789302522.783359:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903e35880 x1876219505189504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302522.783376:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505189504:0@lo:400:kworker.0 00000100:00100000:2.0:1789302522.810697:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505189120:0@lo:400:kworker.0 00000100:00100000:2.0:1789302522.810763:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505189632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302522.810855:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302522.810977:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505189632 00000100:00100000:3.0:1789302522.810988:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505189632 00000100:00100000:3.0:1789302522.811133:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302522.811149:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505189632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302522.811276:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1789302522.811995:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362aa680 x1876219505189632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302522.812166:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505189632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302522.812393:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505189632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 461us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302522.812405:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789302522.957502:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302523.766870:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302523.767007:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302523.767139:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484185216 00000100:00100000:2.0:1789302523.767154:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484185216 00000100:00100000:2.0:1789302523.767256:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789302523.767270:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484185216:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302523.767402:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484185216:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 135us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302523.767411:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00080000:0.0:1789302523.767478:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302523.769958:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484185088 00000100:00100000:1.0:1789302523.769979:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484185088 00000100:00100000:1.0:1789302523.770068:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 204 00000100:00100000:1.0:1789302523.770081:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2351:x1876219484185088:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302523.770185:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2351:x1876219484185088:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 106us (3332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302523.770194:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 204 00010000:00010000:1.0:1789302523.984729:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302525.006637:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302526.029405:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302527.056565:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302527.374609:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302527.374641:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505189760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302527.374728:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302527.374812:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505189760 00000100:00100000:3.0:1789302527.374822:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505189760 00000100:00100000:3.0:1789302527.374896:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302527.374907:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505189760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789302527.374955:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789302527.374962:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302527.375022:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505189760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302527.375029:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789302527.375281:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693beab480 x1876219505189760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302527.375337:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505189760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302527.885845:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302527.885877:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505189888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302527.885967:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302527.886055:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505189888 00000100:00100000:2.0:1789302527.886065:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505189888 00000100:00100000:2.0:1789302527.886149:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789302527.886161:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505189888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302527.886225:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789302527.886253:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302527.886276:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505189888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302527.886301:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1789302527.886347:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693621bb80 x1876219505189888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302527.886369:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505189888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302527.893978:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505190400:0@lo:400:kworker.0 00000100:00100000:3.0:1789302527.894064:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302527.894115:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789302527.894121:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505190016:0@lo:400:kworker.0 00000100:00100000:3.0:1789302527.894149:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302527.894168:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505190528:0@lo:400:kworker.0 00000100:00100000:3.0:1789302527.894189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302527.894221:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505190272:0@lo:400:kworker.0 00000100:00100000:0.0:1789302527.894233:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505190528 00000100:00100000:0.0:1789302527.894244:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505190528 00000100:00100000:3.0:1789302527.894246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302527.894311:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302527.894317:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505190144:0@lo:400:kworker.0 00000100:00100000:0.0:1789302527.894332:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505190272 00000100:00100000:0.0:1789302527.894336:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505190272 00000100:00100000:3.0:1789302527.894341:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302527.894353:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505190144 00000100:00100000:0.0:1789302527.894355:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505190144 00000100:00100000:3.0:1789302527.894369:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505190016 00000100:00100000:3.0:1789302527.894372:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505190016 00000100:00100000:0.0:1789302527.894373:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789302527.894382:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505190528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302527.894401:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789302527.894406:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505190016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302527.894809:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505190400 00000100:00100000:1.0:1789302527.894816:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505190400 00000100:00100000:1.0:1789302527.894976:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302527.894986:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505190400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302527.895135:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789302527.895148:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505190272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302527.900101:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505190016:12345-0@lo:400:kworker.0 Request processed in 5676us (5932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302527.900123:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789302527.900224:0:6295:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789302527.900235:0:6295:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789302527.900321:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505190016:0@lo:400:kworker.0 00000100:00100000:1.0:1789302527.901909:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505190400:12345-0@lo:400:kworker.0 Request processed in 6913us (7833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302527.901929:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302527.901986:0:5845:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789302527.902000:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789302527.902016:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505190144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302527.902094:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505190144:12345-0@lo:400:kworker.0 Request processed in 85us (7751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302527.902121:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1789302527.902183:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903463100 x1876219505190400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302527.902202:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505190400:0@lo:400:kworker.0 00000100:00100000:3.0:1789302527.902324:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505190144:0@lo:400:kworker.0 00000100:00080000:1.0:1789302527.902342:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302527.903543:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505190272:12345-0@lo:400:kworker.0 Request processed in 8383us (9279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302527.903557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789302527.905650:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505190272:0@lo:400:kworker.0 00000100:00100000:0.0:1789302527.911691:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505190528:12345-0@lo:400:kworker.0 Request processed in 17295us (17485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302527.911715:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505190528:0@lo:400:kworker.0 00000100:00100000:0.0:1789302527.911727:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1789302528.080105:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302528.881749:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302528.881802:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302528.881838:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484185472 00000100:00100000:0.0:1789302528.881851:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484185472 00000100:00100000:0.0:1789302528.881930:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789302528.881944:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484185472:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302528.882035:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484185472:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 95us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302528.882043:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789302528.882069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484185344 00000100:00100000:0.0:1789302528.882072:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484185344 00000100:00100000:0.0:1789302528.882099:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 206 00000100:00100000:0.0:1789302528.882105:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2351:x1876219484185344:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302528.882133:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2351:x1876219484185344:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302528.882139:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 206 00000100:00080000:0.0:1789302528.882166:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789302529.113459:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302530.125663:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302531.151371:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302532.180051:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302532.493786:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302532.493815:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505190656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302532.493931:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302532.494575:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505190656 00000100:00100000:2.0:1789302532.494589:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505190656 00000100:00100000:2.0:1789302532.494683:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789302532.494696:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505190656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302532.494754:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302532.494830:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505190656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302532.494849:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789302532.495391:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302532.495455:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362ace00 x1876219505190656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302532.495478:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505190656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302533.005803:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693621bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505190784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302533.005899:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302533.005994:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505190784 00000100:00100000:2.0:1789302533.006013:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505190784 00000100:00100000:2.0:1789302533.006087:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302533.006202:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505190784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302533.006250:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302533.006333:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505190784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302533.006340:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789302533.006367:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302533.006581:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505190912:0@lo:400:kworker.0 00000100:00100000:3.0:1789302533.006628:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302533.006658:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505191424:0@lo:400:kworker.0 00000100:00100000:3.0:1789302533.006685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302533.006706:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302533.006712:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505191040:0@lo:400:kworker.0 00000100:00100000:3.0:1789302533.006732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302533.006763:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505190912 00000100:00100000:3.0:1789302533.006767:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505190912 00000100:00100000:3.0:1789302533.006799:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789302533.006807:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505190912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302533.006846:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505190912:12345-0@lo:400:kworker.0 Request processed in 39us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302533.006852:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789302533.006894:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505190912:0@lo:400:kworker.0 00010000:00080000:2.0:1789302533.007781:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693621bb80 x1876219505190784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302533.007805:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693621bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505190784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302533.007829:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505191296:0@lo:400:kworker.0 00000100:00100000:2.0:1789302533.007874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302533.007910:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302533.007918:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505191168:0@lo:400:kworker.0 00000100:00100000:2.0:1789302533.007943:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302533.007984:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505191296 00000100:00100000:2.0:1789302533.007990:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505191296 00000100:00100000:2.0:1789302533.008037:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302533.008046:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505191296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302533.008108:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505191296:12345-0@lo:400:kworker.0 Request processed in 50us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302533.008115:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302533.008140:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505191424 00000100:00100000:2.0:1789302533.008145:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505191424 00000100:00100000:2.0:1789302533.008184:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505191040 00000100:00100000:2.0:1789302533.008188:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505191040 00000100:00100000:2.0:1789302533.008220:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505191168 00000100:00100000:2.0:1789302533.008223:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505191168 00000100:00100000:2.0:1789302533.008239:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789302533.008245:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505191424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302533.008309:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505191424:12345-0@lo:400:kworker.0 Request processed in 64us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302533.008316:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789302533.008329:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789302533.008336:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505191040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302533.008368:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505191040:12345-0@lo:400:kworker.0 Request processed in 33us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302533.008374:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789302533.008385:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789302533.011950:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505191168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302533.012086:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505191168:12345-0@lo:400:kworker.0 Request processed in 3695us (4141us total) trans 0 rc 0/0 00000100:00080000:0.0:1789302533.012957:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302533.013019:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505191168:0@lo:400:kworker.0 00010000:00080000:0.0:1789302533.013042:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903461500 x1876219505191296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302533.013054:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505191296:0@lo:400:kworker.0 00000100:00100000:2.0:1789302533.013393:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789302533.013461:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505191040:0@lo:400:kworker.0 00000100:00100000:2.0:1789302533.013475:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505191424:0@lo:400:kworker.0 00010000:00010000:3.0:1789302533.197531:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302534.003430:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302534.003536:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302534.003637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484185728 00000100:00100000:1.0:1789302534.003650:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484185728 00000100:00100000:1.0:1789302534.003746:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:1.0:1789302534.003761:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484185728:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302534.003864:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484185728:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302534.003873:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00080000:0.0:1789302534.004338:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302534.004745:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484185600 00000100:00100000:3.0:1789302534.004753:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484185600 00000100:00100000:3.0:1789302534.004814:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 208 00000100:00100000:3.0:1789302534.004824:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2353:x1876219484185600:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302534.004890:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2353:x1876219484185600:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 68us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302534.004898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 208 00010000:00010000:1.0:1789302534.222153:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302535.250420:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302535.429230:0:10131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:28:52 (1789302532) === 00000100:00100000:0.0:1789302535.841120:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302535.845389:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484185856 00000100:00100000:2.0:1789302535.845411:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484185856 00000100:00100000:2.0:1789302535.847039:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 209 00000100:00100000:2.0:1789302535.847079:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:8150:x1876219484185856:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789302535.847105:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302535.847166:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abe000/0x20be524657f115d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b35a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302535.847208:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abe000/0x20be524657f115d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35a3 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302535.847222:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abe000/0x20be524657f115d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35a3 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302535.847233:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abe000, rc 0) 00000100:00100000:2.0:1789302535.847409:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8150:x1876219484185856:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 354us (6303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302535.847417:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 209 00000100:00100000:1.0:1789302535.855753:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302535.856093:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484185984 00000100:00100000:0.0:1789302535.856108:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484185984 00000100:00100000:0.0:1789302535.856225:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 210 00000100:00100000:0.0:1789302535.856239:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8150:x1876219484185984:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789302535.857230:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8150:x1876219484185984:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 989us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302535.857242:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 210 00000100:00100000:1.0:1789302535.868425:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302535.872706:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484186112 00000100:00100000:2.0:1789302535.872732:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484186112 00000100:00100000:2.0:1789302535.872847:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 211 00000100:00100000:2.0:1789302535.872859:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8150:x1876219484186112:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789302535.873204:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8150:x1876219484186112:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 345us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302535.873213:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 211 00000100:00100000:1.0:1789302535.882267:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302535.882459:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484186240 00000100:00100000:0.0:1789302535.882484:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484186240 00000100:00100000:0.0:1789302535.882563:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 212 00000100:00100000:0.0:1789302535.882575:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8154:x1876219484186240:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302535.882945:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8154:x1876219484186240:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 371us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302535.882964:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 212 00000100:00100000:1.0:1789302535.900650:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302535.900856:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484186368 00000100:00100000:3.0:1789302535.900869:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484186368 00000100:00100000:3.0:1789302535.900945:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 213 00000100:00100000:3.0:1789302535.900958:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8154:x1876219484186368:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302535.901426:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8154:x1876219484186368:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 468us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302535.901436:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 213 00000100:00100000:1.0:1789302535.909614:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302535.915324:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484186496 00000100:00100000:0.0:1789302535.915346:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484186496 00000100:00100000:0.0:1789302535.915489:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 214 00000100:00100000:0.0:1789302535.915503:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:8150:x1876219484186496:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789302535.915537:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302535.915563:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6942045a00/0x20be524657f115de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b35cd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302535.915601:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6942045a00/0x20be524657f115de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35cd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302535.915647:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6942045a00/0x20be524657f115de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35cd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302535.915659:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045a00, rc 0) 00000100:00100000:0.0:1789302535.915741:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:8150:x1876219484186496:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 241us (6141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302535.915748:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 214 00000100:00100000:1.0:1789302535.918927:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302535.919034:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484186624 00000100:00100000:2.0:1789302535.919049:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484186624 00000100:00100000:2.0:1789302535.919120:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 215 00000100:00100000:2.0:1789302535.919133:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:8150:x1876219484186624:12345-192.168.203.42@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789302535.919167:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789302535.919198:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789302535.919202:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789302535.919206:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789302535.919214:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789302535.922008:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:8150:x1876219484186624:12345-192.168.203.42@tcp:256:mount.lustre.0 Request processed in 2860us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302535.922028:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 215 00000100:00100000:1.0:1789302535.925947:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302535.926053:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484186752 00000100:00100000:0.0:1789302535.926067:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484186752 00000100:00100000:0.0:1789302535.926138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 216 00000100:00100000:0.0:1789302535.926151:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:8150:x1876219484186752:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789302535.926174:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302535.926199:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b35d4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302535.926237:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302535.926252:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302535.926263:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044000, rc 0) 00000100:00100000:2.0:1789302535.928991:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8150:x1876219484186752:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 2821us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302535.929009:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 216 00000100:00100000:1.0:1789302535.932823:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302535.932927:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484186880 00000100:00100000:2.0:1789302535.932942:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484186880 00000100:00100000:2.0:1789302535.933010:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 217 00000100:00100000:2.0:1789302535.933023:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8150:x1876219484186880:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789302535.933436:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8150:x1876219484186880:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 414us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302535.933445:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 217 00000100:00100000:1.0:1789302535.935860:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302535.935959:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484187008 00000100:00100000:2.0:1789302535.935970:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484187008 00000100:00100000:2.0:1789302535.936037:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 218 00000100:00100000:2.0:1789302535.936050:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8150:x1876219484187008:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789302535.936364:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8150:x1876219484187008:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 316us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302535.936373:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 218 00000100:00100000:1.0:1789302535.941428:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302535.941603:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484187136 00000100:00100000:3.0:1789302535.941618:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484187136 00000100:00100000:3.0:1789302535.941711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 219 00000100:00100000:3.0:1789302535.941725:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8158:x1876219484187136:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302535.942077:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8158:x1876219484187136:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 354us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302535.942087:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 219 00000100:00100000:1.0:1789302535.945372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302535.945507:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484187264 00000100:00100000:0.0:1789302535.945530:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484187264 00000100:00100000:0.0:1789302535.945600:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 220 00000100:00100000:0.0:1789302535.945611:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8158:x1876219484187264:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302535.946276:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:8158:x1876219484187264:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 663us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302535.947179:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 220 00000100:00100000:1.0:1789302535.962451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302535.962517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302535.962747:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484187776 00000100:00100000:0.0:1789302535.962761:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484187776 00000100:00100000:0.0:1789302535.962846:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484187392 00000100:00100000:0.0:1789302535.962850:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484187392 00000100:00100000:0.0:1789302535.962882:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:0.0:1789302535.962895:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484187776:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302535.963000:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484187776:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 107us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302535.963008:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:0.0:1789302535.963031:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:0.0:1789302535.963037:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1876219484187392:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789302535.963076:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2f0a8600-9374-4911-bbb2-b7f7408433cb@192.168.203.42@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1789302535.963122:0:5845:0:(genops.c:1384:class_connect()) connect: client 2f0a8600-9374-4911-bbb2-b7f7408433cb, cookie 0x20be524657f115ec 00000004:00100000:0.0:1789302535.963163:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789302535.964340:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a6806f02000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302535.964585:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:2350:x1876219484187392:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 1542us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302535.964597:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789302535.970039:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302535.970105:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302535.970281:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484187520 00000100:00100000:2.0:1789302535.970341:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484187520 00000100:00100000:2.0:1789302535.970534:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484187648 00000100:00100000:2.0:1789302535.970539:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484187648 00000100:00080000:0.0:1789302535.972735:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302535.973194:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789302535.973227:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+7:0:x1876219484187520:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789302535.973308:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789302535.973701:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:2.0:1789302535.973716:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+7:8150:x1876219484187648:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789302535.973751:0:6295:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789302535.973863:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+7:0:x1876219484187520:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 645us (3830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302535.973877:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:2.0:1789302535.973951:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:8150:x1876219484187648:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 236us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302535.973961:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789302535.981023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302535.981452:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484187904 00000100:00100000:3.0:1789302535.981467:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484187904 00000100:00100000:3.0:1789302535.981619:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:3.0:1789302535.981632:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:8150:x1876219484187904:12345-192.168.203.42@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789302535.981746:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:8150:x1876219484187904:12345-192.168.203.42@tcp:40:mount.lustre.0 Request processed in 117us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302535.981753:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:1.0:1789302535.988425:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302535.988489:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302535.988643:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484188288 00000100:00100000:3.0:1789302535.988656:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484188288 00000100:00100000:3.0:1789302535.988735:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:3.0:1789302535.988748:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:8150:x1876219484188288:12345-192.168.203.42@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789302535.988843:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789302535.988939:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:8150:x1876219484188288:12345-192.168.203.42@tcp:33:mount.lustre.0 Request processed in 193us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302535.988946:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:2.0:1789302535.989565:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484188032 00000100:00100000:2.0:1789302535.989573:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484188032 00000100:00100000:2.0:1789302535.989606:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:2.0:1789302535.989613:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876219484188032:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789302535.989644:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2f0a8600-9374-4911-bbb2-b7f7408433cb@192.168.203.42@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1789302535.989686:0:6696:0:(genops.c:1384:class_connect()) connect: client 2f0a8600-9374-4911-bbb2-b7f7408433cb, cookie 0x20be524657f115f3 00002000:00100000:2.0:1789302535.989701:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f0a8600-9374-4911-bbb2-b7f7408433cb/ffff9a6936200000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789302535.989731:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789302535.990042:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789302535.990089:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9a6936204800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302535.990159:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:2350:x1876219484188032:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 545us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302535.990167:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789302535.992170:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302535.992353:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484188160 00000100:00100000:0.0:1789302535.992367:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484188160 00000100:00100000:0.0:1789302535.992421:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:0.0:1789302535.992430:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876219484188160:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789302535.992497:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2f0a8600-9374-4911-bbb2-b7f7408433cb@192.168.203.42@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1789302535.992681:0:6697:0:(genops.c:1384:class_connect()) connect: client 2f0a8600-9374-4911-bbb2-b7f7408433cb, cookie 0x20be524657f115fa 00002000:00100000:0.0:1789302535.992698:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f0a8600-9374-4911-bbb2-b7f7408433cb/ffff9a6806f03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302535.992732:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789302535.993007:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789302535.993052:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9a6806f01800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302535.993653:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:2350:x1876219484188160:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 1219us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302535.993665:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00010000:00010000:3.0:1789302536.270210:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302537.293699:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302537.616567:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505191552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302537.616635:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302537.616709:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505191552 00000100:00100000:0.0:1789302537.616717:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505191552 00000100:00100000:0.0:1789302537.616771:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789302537.616780:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505191552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302537.616801:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302537.616843:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505191552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302537.616849:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789302537.616870:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302537.616897:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362af100 x1876219505191552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302537.616915:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505191552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302538.127603:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505191680:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.127667:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302538.127718:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505192192:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.127745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302538.127771:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789302538.127778:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505191808:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.127799:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302538.127817:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505192320:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.127838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302538.127867:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505191936:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.127903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302538.127925:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302538.127931:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505192064:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.127953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302538.127983:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505192192 00000100:00100000:3.0:1789302538.127991:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505192192 00000100:00100000:3.0:1789302538.128039:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505191808 00000100:00100000:3.0:1789302538.128042:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505191808 00000100:00100000:3.0:1789302538.128058:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505191936 00000100:00100000:3.0:1789302538.128061:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505191936 00000100:00100000:3.0:1789302538.128078:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789302538.128086:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505192192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.128137:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505192192:12345-0@lo:400:kworker.0 Request processed in 52us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302538.128144:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789302538.128160:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789302538.128174:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505191808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.128204:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505191808:12345-0@lo:400:kworker.0 Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302538.128210:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789302538.128223:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789302538.128229:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505191936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.128259:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505191936:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302538.128265:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789302538.128309:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505192320 00000100:00100000:3.0:1789302538.128312:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505192320 00000100:00100000:3.0:1789302538.128339:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505192064 00000100:00100000:3.0:1789302538.128342:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505192064 00000100:00100000:3.0:1789302538.128355:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302538.128360:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505192320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.128389:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505192320:12345-0@lo:400:kworker.0 Request processed in 29us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302538.128395:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302538.128406:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789302538.128412:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505192064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.128436:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505192064:12345-0@lo:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302538.128442:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789302538.128468:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302538.128473:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789302538.128507:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903463b80 x1876219505192064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302538.128533:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505192064:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.128547:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505191936:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.128580:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505191808:0@lo:400:kworker.0 00010000:00080000:3.0:1789302538.128590:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6903462300 x1876219505192320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302538.128599:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505192320:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.128609:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505192192:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.132552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505191680 00000100:00100000:3.0:1789302538.132568:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505191680 00000100:00100000:3.0:1789302538.132628:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789302538.132639:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505191680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.132731:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505191680:12345-0@lo:400:kworker.0 Request processed in 93us (5062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302538.132738:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789302538.132792:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505191680:0@lo:400:kworker.0 00000100:00100000:3.0:1789302538.133687:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302538.133702:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505192448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302538.133750:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302538.133786:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505192448 00000100:00100000:3.0:1789302538.133791:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505192448 00000100:00100000:3.0:1789302538.133828:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789302538.133835:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505192448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302538.133876:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302538.133914:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505192448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302538.133921:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789302538.133954:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c76d880 x1876219505192448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302538.133973:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505192448:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789302538.178927:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f0a8600-9374-4911-bbb2-b7f7408433cb 00010000:00010000:2.0:1789302538.317806:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789302538.728790:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f0a8600-9374-4911-bbb2-b7f7408433cb 00000001:00100000:3.0:1789302539.217477:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f0a8600-9374-4911-bbb2-b7f7408433cb 00010000:00010000:3.0:1789302539.353477:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302540.366637:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302541.172019:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302541.172071:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302541.172144:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302541.172183:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302541.172209:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302541.172344:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484188672 00000100:00100000:0.0:1789302541.172344:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484188928 00000100:00100000:3.0:1789302541.172369:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484188672 00000100:00100000:0.0:1789302541.172369:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484188928 00000100:00100000:3.0:1789302541.172468:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484188544 00000100:00100000:3.0:1789302541.172472:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484188544 00000100:00100000:2.0:1789302541.172622:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484188416 00000100:00100000:2.0:1789302541.172627:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484188416 00000100:00100000:2.0:1789302541.172666:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 222 00000100:00100000:2.0:1789302541.172678:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484188416:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302541.172773:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484188416:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 97us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302541.172781:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 222 00000100:00100000:2.0:1789302541.172984:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484188800 00000100:00100000:2.0:1789302541.172989:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484188800 00000100:00100000:0.0:1789302541.180029:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:0.0:1789302541.180055:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484188928:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302541.180178:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484188928:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 133us (8032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302541.180187:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:0.0:1789302541.180238:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:0.0:1789302541.180248:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484188672:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302541.180308:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484188672:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 37us (8212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302541.180317:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00080000:1.0:1789302541.186085:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302541.186099:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302541.186112:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302541.186782:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:3.0:1789302541.186800:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484188544:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302541.187555:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484188544:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 750us (15360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302541.187567:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:2.0:1789302541.187936:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:2.0:1789302541.187948:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484188800:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302541.188000:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484188800:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 56us (15790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302541.188007:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00010000:00010000:2.0:1789302541.389894:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789302542.089759:0:10326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789302542.418208:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302542.734317:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302542.734771:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505192576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302542.735000:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302542.735244:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505192576 00000100:00100000:3.0:1789302542.735257:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505192576 00000100:00100000:3.0:1789302542.735410:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302542.735422:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505192576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789302542.735499:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302542.735761:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505192576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 340us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302542.735788:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789302542.735899:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362af100 x1876219505192576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302542.735922:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505192576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789302542.736185:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302543.245951:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505192704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302543.246060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302543.246167:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505192704 00000100:00100000:3.0:1789302543.246180:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505192704 00000100:00100000:3.0:1789302543.246248:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789302543.246258:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505192704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302543.246391:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302543.246450:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505192704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302543.246458:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789302543.246733:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c76d880 x1876219505192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302543.246759:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505192704:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789302543.250737:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302543.250947:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505192960:0@lo:400:kworker.0 00000100:00100000:3.0:1789302543.251126:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505192832:0@lo:400:kworker.0 00000100:00100000:3.0:1789302543.251241:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302543.251323:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505193344:0@lo:400:kworker.0 00000100:00100000:3.0:1789302543.251351:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302543.251399:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302543.251406:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505193216:0@lo:400:kworker.0 00000100:00100000:3.0:1789302543.251448:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302543.251649:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302543.251683:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302543.251690:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505193088:0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.251717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302543.251754:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505192832 00000100:00100000:0.0:1789302543.251764:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505192832 00000100:00100000:0.0:1789302543.251823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789302543.251834:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505192832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.251895:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505192832:12345-0@lo:400:kworker.0 Request processed in 63us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302543.251902:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789302543.251941:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505193216 00000100:00100000:0.0:1789302543.251954:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505193216 00000100:00100000:0.0:1789302543.251986:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789302543.251993:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505193216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.252358:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505193216:12345-0@lo:400:kworker.0 Request processed in 364us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302543.252365:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789302543.252462:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505193344 00000100:00100000:0.0:1789302543.252467:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505193344 00000100:00100000:0.0:1789302543.252573:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505192960 00000100:00100000:0.0:1789302543.252577:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505192960 00000100:00100000:0.0:1789302543.252597:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505193088 00000100:00100000:0.0:1789302543.252600:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505193088 00000100:00100000:0.0:1789302543.252616:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789302543.252623:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505193344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.252664:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505193344:12345-0@lo:400:kworker.0 Request processed in 42us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302543.252671:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789302543.252684:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789302543.252691:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505192960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.252722:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505192960:12345-0@lo:400:kworker.0 Request processed in 32us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302543.252729:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789302543.252741:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302543.252746:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505193088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.252775:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505193088:12345-0@lo:400:kworker.0 Request processed in 28us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302543.252781:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789302543.253165:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789302543.253212:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6902ea8000 x1876219505193216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302543.253230:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505193216:0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.253242:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505192832:0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.253255:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505193344:0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.253331:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505193088:0@lo:400:kworker.0 00000100:00100000:0.0:1789302543.253343:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505192960:0@lo:400:kworker.0 00010000:00010000:0.0:1789302543.437771:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302544.475080:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302545.485766:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302546.284157:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302546.284201:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302546.284232:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302546.284255:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302546.284322:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302546.284359:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484189184 00000100:00100000:0.0:1789302546.284371:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484189184 00000100:00100000:0.0:1789302546.284452:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484189312 00000100:00100000:0.0:1789302546.284455:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484189312 00000100:00100000:0.0:1789302546.284488:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:0.0:1789302546.284500:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484189184:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302546.284597:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484189184:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 100us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302546.284605:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:0.0:1789302546.284626:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:0.0:1789302546.284633:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484189312:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302546.284668:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484189312:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 36us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302546.284675:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:0.0:1789302546.284696:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484189440 00000100:00100000:0.0:1789302546.284699:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484189440 00000100:00100000:0.0:1789302546.284726:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484189568 00000100:00100000:0.0:1789302546.284729:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484189568 00000100:00100000:0.0:1789302546.284745:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789302546.284752:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484189440:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302546.284778:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484189440:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302546.284784:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789302546.284796:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:0.0:1789302546.284801:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484189568:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302546.284826:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484189568:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302546.284832:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:0.0:1789302546.284851:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484189056 00000100:00100000:0.0:1789302546.284855:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484189056 00000100:00100000:0.0:1789302546.284879:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 224 00000100:00100000:0.0:1789302546.284886:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484189056:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302546.284911:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484189056:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302546.284917:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 224 00000100:00080000:0.0:1789302546.284955:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302546.284965:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302546.284968:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302546.511137:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302547.533838:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302547.859406:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505193472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302547.860739:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302547.860837:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505193472 00000100:00100000:3.0:1789302547.860873:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505193472 00000100:00100000:3.0:1789302547.861064:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789302547.861076:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505193472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789302547.861132:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302547.861234:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505193472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302547.861242:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789302547.862262:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789302547.862345:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936c53800 x1876219505193472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302547.862375:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505193472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302548.367613:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505193600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302548.369976:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302548.376376:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505193728:0@lo:400:kworker.0 00000100:00100000:1.0:1789302548.376794:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505193600 00000100:00100000:1.0:1789302548.376808:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505193600 00000100:00100000:1.0:1789302548.376889:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789302548.376902:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505193600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302548.376974:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302548.377148:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505193600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 248us (7183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302548.377157:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789302548.377216:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302548.377261:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505193856:0@lo:400:kworker.0 00000100:00100000:1.0:1789302548.377339:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302548.377474:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505193984:0@lo:400:kworker.0 00000100:00100000:1.0:1789302548.377502:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302548.377549:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302548.377556:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505194112:0@lo:400:kworker.0 00000100:00100000:1.0:1789302548.377583:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302548.377585:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505193856 00000100:00100000:3.0:1789302548.377592:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505193856 00000100:00100000:3.0:1789302548.377637:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505193984 00000100:00100000:3.0:1789302548.377641:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505193984 00000100:00100000:1.0:1789302548.377650:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505194112 00000100:00100000:1.0:1789302548.377656:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505194112 00000100:00100000:1.0:1789302548.377693:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789302548.377702:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505193856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302548.377722:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302548.377747:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505193856:12345-0@lo:400:kworker.0 Request processed in 45us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302548.378368:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505193984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302548.378438:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505193984:12345-0@lo:400:kworker.0 Request processed in 76us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302548.378447:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789302548.380422:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302548.380741:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789302548.380769:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505194112:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789302548.381015:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6902ea9880 x1876219505193600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302548.381043:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505193600:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789302548.381111:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302548.381145:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505193856:0@lo:400:kworker.0 00000100:00100000:0.0:1789302548.381186:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505193984:0@lo:400:kworker.0 00000100:00100000:3.0:1789302548.381322:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302548.381411:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505193728 00000100:00100000:0.0:1789302548.381420:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505193728 00000100:00100000:0.0:1789302548.381490:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789302548.381500:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505193728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302548.381576:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505193728:12345-0@lo:400:kworker.0 Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302548.381583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789302548.381775:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505193728:0@lo:400:kworker.0 00000100:00100000:1.0:1789302548.385056:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505194112:12345-0@lo:400:kworker.0 Request processed in 4287us (7456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302548.385076:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789302548.385564:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505194112:0@lo:400:kworker.0 00010000:00010000:0.0:1789302548.557836:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302549.584146:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302550.605943:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302551.405739:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302551.405788:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302551.405832:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302551.405860:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302551.405887:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302551.405941:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484189696 00000100:00100000:0.0:1789302551.405955:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484189696 00000100:00100000:0.0:1789302551.406013:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 226 00000100:00100000:0.0:1789302551.406025:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2354:x1876219484189696:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302551.406110:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2354:x1876219484189696:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302551.406119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 226 00000100:00100000:0.0:1789302551.406163:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484189824 00000100:00100000:0.0:1789302551.406167:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484189824 00000100:00100000:0.0:1789302551.406207:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484189952 00000100:00100000:0.0:1789302551.406210:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484189952 00000100:00100000:0.0:1789302551.406234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:0.0:1789302551.406242:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484189824:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302551.406252:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484190080 00000100:00100000:2.0:1789302551.406260:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484190080 00000100:00100000:0.0:1789302551.406280:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484189824:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 39us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302551.406311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:0.0:1789302551.406328:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:0.0:1789302551.406336:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484189952:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302551.406342:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484190208 00000100:00100000:2.0:1789302551.406348:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484190208 00000100:00100000:0.0:1789302551.406378:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484189952:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302551.406385:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:2.0:1789302551.406403:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484190080:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302551.406405:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:0.0:1789302551.406430:0:6696:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789302551.406439:0:6696:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789302551.406600:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484190080:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 206us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302551.406608:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:2.0:1789302551.406628:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00080000:0.0:1789302551.406633:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302551.406639:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484190208:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:0.0:1789302551.406640:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302551.406645:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302551.406680:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484190208:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 44us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302551.406688:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00010000:00010000:2.0:1789302551.634656:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302552.655524:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302552.981718:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505194240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302552.981789:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302552.981905:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505194240 00000100:00100000:2.0:1789302552.981913:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505194240 00000100:00100000:2.0:1789302552.981978:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302552.981988:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505194240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302552.982023:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302552.982074:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505194240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302552.982081:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789302552.982124:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936c53b80 x1876219505194240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302552.982144:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505194240:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789302552.982207:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302553.485553:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302553.485577:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505194368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302553.485642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302553.485715:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505194368 00000100:00100000:2.0:1789302553.485728:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505194368 00000100:00100000:2.0:1789302553.485779:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302553.485788:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505194368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302553.485823:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302553.485867:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505194368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302553.485875:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789302553.485894:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789302553.485921:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c76e680 x1876219505194368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302553.485939:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505194368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302553.489519:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505194624:0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.489583:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302553.489621:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302553.489628:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505194496:0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.489896:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302553.489947:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505194880:0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.489974:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302553.489991:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302553.489997:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505194752:0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.490017:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302553.490042:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505194624 00000100:00100000:0.0:1789302553.490049:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505194624 00000100:00100000:0.0:1789302553.490095:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505194880 00000100:00100000:0.0:1789302553.490099:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505194880 00000100:00100000:0.0:1789302553.490124:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505194752 00000100:00100000:0.0:1789302553.490127:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505194752 00000100:00100000:0.0:1789302553.490143:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789302553.490151:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505194624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.490199:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505194624:12345-0@lo:400:kworker.0 Request processed in 48us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302553.490206:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789302553.490237:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789302553.490243:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505194880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.490274:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505194880:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302553.490281:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789302553.490325:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789302553.490332:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505194752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.490368:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505194752:12345-0@lo:400:kworker.0 Request processed in 37us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302553.490375:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789302553.490492:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505194496 00000100:00100000:2.0:1789302553.490498:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505194496 00000100:00100000:2.0:1789302553.490526:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789302553.490532:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505194496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302553.490565:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505194496:12345-0@lo:400:kworker.0 Request processed in 34us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302553.490571:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:2.0:1789302553.490599:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302553.490783:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505194752:0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.490794:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505194880:0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.490829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505194496:0@lo:400:kworker.0 00000100:00100000:0.0:1789302553.490839:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505194624:0@lo:400:kworker.0 00010000:00010000:3.0:1789302553.677593:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302554.704413:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302555.727255:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302556.526760:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302556.526817:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302556.526857:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302556.526879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302556.526906:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302556.526934:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484190336 00000100:00100000:1.0:1789302556.526945:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484190336 00000100:00100000:1.0:1789302556.526993:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 228 00000100:00100000:1.0:1789302556.527003:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484190336:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302556.527066:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484190336:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 64us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302556.527073:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 228 00000100:00100000:1.0:1789302556.527116:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484190464 00000100:00100000:1.0:1789302556.527120:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484190464 00000100:00100000:1.0:1789302556.527153:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484190592 00000100:00100000:1.0:1789302556.527157:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484190592 00000100:00100000:1.0:1789302556.527177:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:1.0:1789302556.527184:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484190464:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302556.527211:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484190464:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302556.527217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:1.0:1789302556.527230:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:1.0:1789302556.527236:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484190592:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302556.527423:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484190592:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 185us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302556.527429:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:1.0:1789302556.527449:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484190720 00000100:00100000:1.0:1789302556.527453:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484190720 00000100:00100000:1.0:1789302556.527487:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484190848 00000100:00100000:1.0:1789302556.527490:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484190848 00000100:00080000:0.0:1789302556.532932:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302556.532942:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302556.532947:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302556.533897:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:1.0:1789302556.533916:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2350:x1876219484190720:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:1.0:1789302556.533949:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f115f3 00000100:00080000:1.0:1789302556.533961:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a6936204800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789302556.533987:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789302556.534019:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789302556.536129:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+2:2350:x1876219484190720:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 2209us (9236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302556.536145:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:1.0:1789302556.536488:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:1.0:1789302556.536501:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2350:x1876219484190848:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:1.0:1789302556.536529:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f115fa 00000100:00080000:1.0:1789302556.536540:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a6806f01800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789302556.536562:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789302556.536585:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789302556.537503:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+2:2350:x1876219484190848:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 1002us (10590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302556.537513:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00010000:00010000:2.0:1789302556.749886:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302557.778991:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302558.093495:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505195008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302558.093563:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302558.093688:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505195008 00000100:00100000:1.0:1789302558.093695:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505195008 00000100:00100000:1.0:1789302558.093741:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789302558.093748:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505195008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302558.093776:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789302558.095600:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302558.098957:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505195008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5198us (5383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302558.098992:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789302558.099274:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936c52a00 x1876219505195008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302558.099316:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505195008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302558.605833:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505195264:0@lo:400:kworker.0 00000100:00100000:3.0:1789302558.605896:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302558.605967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505195264 00000100:00100000:3.0:1789302558.605974:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505195264 00000100:00100000:3.0:1789302558.606023:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789302558.606030:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505195264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302558.606075:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505195264:12345-0@lo:400:kworker.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302558.606082:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789302558.606116:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505195264:0@lo:400:kworker.0 00000100:00100000:0.0:1789302558.606323:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505195392:0@lo:400:kworker.0 00000100:00100000:0.0:1789302558.606364:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302558.606369:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505195520:0@lo:400:kworker.0 00000100:00100000:1.0:1789302558.606398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302558.606421:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789302558.606427:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505195136:0@lo:400:kworker.0 00000100:00100000:3.0:1789302558.606454:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505195392 00000100:00100000:1.0:1789302558.606455:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302558.606458:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505195392 00000100:00100000:1.0:1789302558.606482:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505195648:0@lo:400:kworker.0 00000100:00100000:3.0:1789302558.606497:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505195520 00000100:00100000:3.0:1789302558.606501:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505195520 00000100:00100000:1.0:1789302558.606505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302558.606518:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789302558.606525:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505195392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302558.606528:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789302558.606536:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505195520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302558.606561:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505195392:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302558.606561:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505195520:12345-0@lo:400:kworker.0 Request processed in 28us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302558.606567:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789302558.606595:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505195520:0@lo:400:kworker.0 00000100:00100000:0.0:1789302558.606606:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505195136 00000100:00100000:0.0:1789302558.606610:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505195136 00000100:00100000:1.0:1789302558.606622:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505195648 00000100:00100000:1.0:1789302558.606625:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505195648 00000100:00100000:0.0:1789302558.606635:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789302558.606641:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505195136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302558.606648:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789302558.606654:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505195648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302558.606676:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505195136:12345-0@lo:400:kworker.0 Request processed in 35us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302558.606678:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505195648:12345-0@lo:400:kworker.0 Request processed in 25us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302558.606682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789302558.606683:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789302558.606708:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505195136:0@lo:400:kworker.0 00000100:00080000:0.0:1789302558.606710:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302558.606715:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789302558.606720:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6902eaf800 x1876219505195648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302558.606743:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505195648:0@lo:400:kworker.0 00000100:00100000:1.0:1789302558.606777:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505195392:0@lo:400:kworker.0 00000100:00100000:1.0:1789302558.613697:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302558.613718:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505195776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302558.613780:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302558.614040:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505195776 00000100:00100000:0.0:1789302558.614049:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505195776 00000100:00100000:0.0:1789302558.614098:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789302558.614106:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505195776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302558.614143:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302558.614205:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505195776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302558.614212:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789302558.614248:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c335500 x1876219505195776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302558.614267:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505195776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302558.618340:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:3.0:1789302558.797483:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789302559.181123:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f0a8600-9374-4911-bbb2-b7f7408433cb 00000020:00000080:0.0:1789302559.181132:0:7652:0:(genops.c:885:class_export_put()) final put ffff9a6806f03000/2f0a8600-9374-4911-bbb2-b7f7408433cb 00000020:00000080:0.0:1789302559.181155:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6806f03000/2f0a8600-9374-4911-bbb2-b7f7408433cb for lustre-OST0001 00000020:00000080:0.0:1789302559.181194:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6806f01800 for lustre-OST0001 00000001:02000400:2.0:1789302559.482720:0:11030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1789302559.719396:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f0a8600-9374-4911-bbb2-b7f7408433cb 00000020:00000080:3.0:1789302559.719404:0:6722:0:(genops.c:885:class_export_put()) final put ffff9a6936200000/2f0a8600-9374-4911-bbb2-b7f7408433cb 00000020:00000080:3.0:1789302559.719429:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936200000/2f0a8600-9374-4911-bbb2-b7f7408433cb for lustre-OST0000 00000020:00000080:3.0:1789302559.719471:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6936204800 for lustre-OST0000 00010000:00010000:2.0:1789302559.821455:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302560.848478:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302561.660414:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302561.660469:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302561.660501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302561.660530:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484191232 00000100:00100000:0.0:1789302561.660540:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484191232 00000100:00100000:0.0:1789302561.660595:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484191104 00000100:00100000:0.0:1789302561.660598:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484191104 00000100:00100000:0.0:1789302561.660623:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:0.0:1789302561.660633:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484191232:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302561.660707:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484191232:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302561.660715:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:0.0:1789302561.660734:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00100000:0.0:1789302561.660740:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484191104:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302561.660764:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484191104:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302561.660770:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00080000:0.0:1789302561.660788:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302561.661489:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484190976 00000100:00100000:3.0:1789302561.661497:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484190976 00000100:00100000:3.0:1789302561.661548:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 230 00000100:00100000:3.0:1789302561.661557:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484190976:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302561.661601:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484190976:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 45us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302561.661618:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 230 00010000:00010000:3.0:1789302561.871219:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789302562.834829:0:11178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd94d45110 20000000:00000080:1.0:1789302562.834849:0:11178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6936aff800 uarg=0000000000000000 20000000:01000000:1.0:1789302562.834885:0:11178:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789302562.834891:0:11178:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789302562.834896:0:11178:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789302562.835758:0:11179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789302562.835890:0:11178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789302562.844272:0:11178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789302562.844344:0:11178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.844787:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.844798:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f115ad expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.844805:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f115bb expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.844812:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f115c9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.844839:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.844846:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.844894:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.844911:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 12 pid: 5840 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.844926:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c334a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505195904:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302562.845870:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f115c9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.845881:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f115c9 expref: 18 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.845893:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c335500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505196032:0@lo:104: 00000100:00100000:1.0:1789302562.845935:0:11178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302562.845985:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f115bb expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.845994:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f115bb expref: 18 pid: 5840 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.846003:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c334700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505196160:0@lo:104: 00000100:00100000:1.0:1789302562.846039:0:11178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302562.846076:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f115ad expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.846085:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f115ad expref: 18 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.846093:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936328000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505196288:0@lo:104: 00000100:00100000:1.0:1789302562.846116:0:11178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302562.846136:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.846145:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 12 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.846155:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693632bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505196416:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302562.846184:0:11178:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302562.848687:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505196032 00000100:00100000:2.0:1789302562.848703:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505196032 00000100:00100000:2.0:1789302562.848755:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505196160 00000100:00100000:2.0:1789302562.848759:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505196160 00000100:00100000:2.0:1789302562.848791:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505196288 00000100:00100000:2.0:1789302562.848795:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505196288 00000100:00100000:2.0:1789302562.848813:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302562.848823:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+5:11178:x1876219505196032:12345-0@lo:104: 00010000:00010000:2.0:1789302562.848840:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.848939:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302562.848946:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+5:11178:x1876219505196032:12345-0@lo:104: Request processed in 125us (3010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302562.848953:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302562.848972:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789302562.848978:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+4:11178:x1876219505196160:12345-0@lo:104: 00010000:00010000:2.0:1789302562.848986:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849022:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789302562.849027:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+4:11178:x1876219505196160:12345-0@lo:104: Request processed in 50us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302562.849033:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789302562.849044:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302562.849050:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:11178:x1876219505196288:12345-0@lo:104: 00010000:00010000:2.0:1789302562.849058:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849089:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789302562.849094:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8df8e325-951a-4604-89fa-82b64ca867d0+3:11178:x1876219505196288:12345-0@lo:104: Request processed in 45us (2978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302562.849108:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789302562.849128:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789302562.849134:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849142:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900030c00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302562.849146:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849155:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302562.849162:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302562.849168:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789302562.849198:0:8459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849205:0:8459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302562.849233:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849241:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900030c00/0x20be524657f115c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849253:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302562.849256:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849271:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302562.849274:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849281:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302562.849320:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302562.849325:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789302562.849471:0:8459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849477:0:8459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302562.849493:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849499:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c9000/0x20be524657f115bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849510:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302562.849513:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849518:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031c00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302562.849521:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849538:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302562.849544:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302562.849549:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789302562.849563:0:8459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849569:0:8459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302562.849576:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849583:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900031c00/0x20be524657f115ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f115b4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849597:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302562.849599:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302562.849601:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302562.849609:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302562.849615:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302562.849629:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505196544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302562.849667:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302562.849708:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505196672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302562.849729:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302562.849746:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302562.849752:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505196800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302562.849783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302562.849811:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505196544 00000100:00100000:2.0:1789302562.849815:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505196544 00010000:00010000:2.0:1789302562.849835:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f115c9 expref: 19 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302562.849856:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505196672 00000100:00100000:2.0:1789302562.849859:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505196672 00010000:00010000:2.0:1789302562.849870:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f115bb expref: 20 pid: 5840 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302562.849880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505196800 00000100:00100000:2.0:1789302562.849882:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505196800 00010000:00010000:2.0:1789302562.849891:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f115ad expref: 21 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302562.849902:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789302562.849908:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690bb71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+21:3303:x1876219505196544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302562.849919:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302562.849924:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f115c9 expref: 21 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849934:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f115c9 expref: 21 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.849949:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302562.849976:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690bb71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+21:3303:x1876219505196544:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302562.849983:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789302562.850018:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302562.850030:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505196672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302562.850038:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302562.850042:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f115bb expref: 20 pid: 5840 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.850049:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f115bb expref: 20 pid: 5840 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.850058:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302562.850086:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505196672:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302562.850091:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302562.850104:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302562.850110:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505196800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302562.850117:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302562.850121:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f115ad expref: 19 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.850127:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f115ad expref: 19 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302562.850136:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302562.850155:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505196800:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302562.850160:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302562.850200:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505196544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302562.850223:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505196800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302562.850230:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505196672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302562.850501:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7600/0x20be524657f115d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f115c9 expref: 18 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.850513:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c335500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505196032:0@lo:104: 00010000:00010000:1.0:1789302562.850524:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba6000/0x20be524657f115c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f115bb expref: 17 pid: 5840 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.850532:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c334700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505196160:0@lo:104: 00010000:00010000:1.0:1789302562.850541:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abf000/0x20be524657f115b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f115ad expref: 16 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.850549:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936328000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505196288:0@lo:104: 00010000:00010000:3.0:1789302562.850866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302562.865803:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c334a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505195904:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302562.866465:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302562.866539:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302562.866987:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484191360 00000100:00100000:0.0:1789302562.866996:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484191360 00010000:00010000:0.0:1789302562.867035:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 13 pid: 5840 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302562.867074:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484191488 00000100:00100000:0.0:1789302562.867078:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484191488 00010000:00010000:0.0:1789302562.867090:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 14 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302562.867113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:3.0:1789302562.867135:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:0.0:1789302562.867136:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+14:2352:x1876219484191360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789302562.867142:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+14:2352:x1876219484191488:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302562.867152:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302562.867152:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302562.867158:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 14 pid: 5840 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302562.867159:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 14 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.867170:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 14 pid: 5840 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302562.867250:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693632bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1876219505196416:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302562.871264:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 14 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302562.871314:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abfc00/0x20be524657f115a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b359c expref: 14 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302562.871341:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302562.871427:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484191488:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 4284us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302562.871439:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00010000:00010000:1.0:1789302562.872090:0:11178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874124:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6942044000/0x20be524657f115e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35d4 expref: 12 pid: 5840 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874147:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874155:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874178:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874185:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874192:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874200:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874206:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302562.874211:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874233:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874255:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302562.874269:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302562.874989:0:11178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.875003:0:11178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302562.875010:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c8c00/0x20be524657f11601 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302562.875981:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:2352:x1876219484191360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7220us (7891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302562.875993:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00010000:00010000:2.0:1789302562.896405:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302563.213565:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302563.213588:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505196928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302563.213669:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302563.213868:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505196928 00000100:00100000:1.0:1789302563.213878:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505196928 00000100:00100000:1.0:1789302563.213951:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302563.213960:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505196928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302563.213993:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302563.214044:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505196928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302563.214051:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789302563.214089:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936c51880 x1876219505196928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302563.214106:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505196928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302563.214180:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302563.725610:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302563.725634:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505197056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302563.725700:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302563.725962:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505197056 00000100:00100000:1.0:1789302563.725969:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505197056 00000100:00100000:1.0:1789302563.726045:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789302563.726055:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505197056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302563.726091:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302563.726139:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505197056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302563.726146:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789302563.726183:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6902ead880 x1876219505197056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302563.726202:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505197056:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789302563.726746:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302563.726886:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302563.726897:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505197440:0@lo:400:kworker.0 00000100:00100000:3.0:1789302563.726935:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302563.726975:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505197440 00000100:00100000:3.0:1789302563.726980:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505197440 00000100:00100000:3.0:1789302563.727021:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789302563.727036:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505197440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302563.727076:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505197440:12345-0@lo:400:kworker.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302563.727082:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1789302563.727101:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302563.727119:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505197440:0@lo:400:kworker.0 00000100:00100000:0.0:1789302563.727203:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505197312:0@lo:400:kworker.0 00000100:00100000:0.0:1789302563.727232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302563.727253:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789302563.727259:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505197184:0@lo:400:kworker.0 00000100:00100000:0.0:1789302563.727313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302563.727338:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505197312 00000100:00100000:0.0:1789302563.727342:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505197312 00000100:00100000:0.0:1789302563.727370:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505197184 00000100:00100000:0.0:1789302563.727373:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505197184 00000100:00100000:0.0:1789302563.727388:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789302563.727394:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505197312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302563.727428:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505197312:12345-0@lo:400:kworker.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302563.727443:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789302563.727457:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789302563.727462:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505197184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302563.727490:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505197184:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302563.727495:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789302563.727527:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505197184:0@lo:400:kworker.0 00000100:00100000:0.0:1789302563.727537:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505197312:0@lo:400:kworker.0 00000100:00080000:3.0:1789302563.727646:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1789302563.919220:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789302563.919227:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6936077800 from 7 10000000:01000000:3.0:1789302563.919231:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302563.919276:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302563.919394:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302563.919406:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302563.919432:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505197568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789302563.919492:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302563.919534:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302563.919831:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505197568 00000100:00100000:2.0:1789302563.919839:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505197568 00000100:00100000:2.0:1789302563.919913:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789302563.919922:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505197568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302563.919943:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302563.919956:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11608 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.919979:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11608 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.919989:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11608 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.919998:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abec00, rc 0) 00000100:00100000:2.0:1789302563.920037:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505197568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302563.920043:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789302563.920184:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505197568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302563.920198:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302563.920232:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302563.920304:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505197696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302563.920341:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789302563.923334:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302563.931427:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302563.931480:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505197696 00000100:00100000:0.0:1789302563.931490:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505197696 00000100:00100000:0.0:1789302563.931737:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789302563.931749:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505197696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302563.932054:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505197696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (11711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302563.932063:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789302563.932132:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505197696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302563.932177:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505197824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302563.932342:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302563.932528:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302563.932622:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505197824 00000100:00100000:2.0:1789302563.932627:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505197824 00000100:00100000:2.0:1789302563.932652:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789302563.932658:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505197824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.932849:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505197824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302563.932856:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789302563.932922:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505197824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789302563.934436:0:11198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789302563.934668:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789302563.934701:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302563.934711:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.934723:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302563.934734:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789302563.934736:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6902e2c800 from 7 10000000:01000000:2.0:1789302563.934739:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302563.936635:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.936652:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.936665:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302563.936694:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505197952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.936760:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302563.936857:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302563.936882:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505197952 00000100:00100000:2.0:1789302563.936889:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505197952 00000100:00100000:2.0:1789302563.936931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789302563.936938:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505197952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302563.936953:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302563.936971:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11616 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.937011:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11616 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.937022:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11616 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.937031:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6923abf000, rc 0) 00000100:00100000:2.0:1789302563.937064:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505197952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302563.937071:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789302563.937113:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505197952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302563.937125:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.937135:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302563.937184:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.937206:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302563.937219:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302563.937229:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505198080 00000100:00100000:2.0:1789302563.937233:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505198080 00000100:00100000:2.0:1789302563.937256:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789302563.937262:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505198080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.937498:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505198080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302563.937514:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789302563.937540:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.938008:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.938047:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302563.938115:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789302563.938128:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505198208 00000100:00100000:2.0:1789302563.938132:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505198208 00000100:00100000:3.0:1789302563.938176:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789302563.938186:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505198208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302563.938373:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505198208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302563.938380:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789302563.938422:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789302563.939156:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789302563.942846:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789302563.942883:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302563.942896:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.942909:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302563.942921:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789302563.942923:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6905909800 from 7 10000000:01000000:2.0:1789302563.942925:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302563.942964:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.942972:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.942981:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302563.943004:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.943081:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302563.943161:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302563.943200:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505198336 00000100:00100000:3.0:1789302563.943207:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505198336 00000100:00100000:3.0:1789302563.943305:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789302563.943315:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505198336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302563.943337:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302563.943350:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11624 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302563.943374:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11624 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302563.943384:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11624 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302563.943392:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6800, rc 0) 00000100:00100000:3.0:1789302563.943437:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505198336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302563.943444:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789302563.943519:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302563.943534:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302563.943640:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302563.943692:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.943718:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302563.943792:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789302563.944006:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505198464 00000100:00100000:3.0:1789302563.944011:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505198464 00000100:00100000:3.0:1789302563.944063:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789302563.944070:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505198464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302563.944316:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505198464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302563.944323:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789302563.944389:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302563.944417:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693632bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302563.944453:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302563.944538:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302563.944639:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505198592 00000100:00100000:2.0:1789302563.944644:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505198592 00000100:00100000:2.0:1789302563.944669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789302563.944676:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505198592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302563.948347:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505198592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3663us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302563.948362:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789302563.948527:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693632bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505198592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789302563.949473:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789302563.949743:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789302563.949763:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302563.949803:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302563.949816:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302564.655776:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302564.656282:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484191616 00000100:00100000:3.0:1789302564.656320:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484191616 00000100:00100000:3.0:1789302564.656377:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00100000:3.0:1789302564.656387:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:5594:x1876219484191616:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302564.656405:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302564.656436:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b35fe expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302564.656468:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302564.656480:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302564.656490:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7000, rc 0) 00000100:00100000:3.0:1789302564.656745:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484191616:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 357us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302564.656752:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00100000:3.0:1789302564.666457:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302564.666571:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484191744 00000100:00100000:0.0:1789302564.666580:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484191744 00000100:00100000:0.0:1789302564.666631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 241 00000100:00100000:0.0:1789302564.666640:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484191744:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302564.666918:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484191744:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 277us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302564.666926:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 241 00000100:00100000:1.0:1789302564.672750:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302564.672833:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484191872 00000100:00100000:3.0:1789302564.672843:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484191872 00000100:00100000:3.0:1789302564.672897:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 242 00000100:00100000:3.0:1789302564.672907:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484191872:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302564.673138:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484191872:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 231us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302564.673146:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 242 00000100:00100000:1.0:1789302564.687321:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302564.687450:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484192000 00000100:00100000:0.0:1789302564.687460:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484192000 00000100:00100000:0.0:1789302564.687528:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 243 00000100:00100000:0.0:1789302564.687554:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484192000:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302564.687572:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302564.687589:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3605 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302564.687617:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302564.687627:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302564.687635:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044000, rc 0) 00000100:00100000:0.0:1789302564.687731:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484192000:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 179us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302564.687738:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 243 00000100:00100000:1.0:1789302564.689995:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302564.696019:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484192128 00000100:00100000:0.0:1789302564.696034:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484192128 00000100:00100000:0.0:1789302564.696169:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 244 00000100:00100000:0.0:1789302564.696182:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484192128:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302564.696518:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484192128:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 339us (6530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302564.696527:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 244 00000100:00100000:1.0:1789302564.705379:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302564.705543:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484192256 00000100:00100000:3.0:1789302564.705553:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484192256 00000100:00100000:3.0:1789302564.705608:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 245 00000100:00100000:3.0:1789302564.705618:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484192256:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302564.705836:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484192256:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 218us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302564.705854:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 245 00010000:00010000:3.0:1789302564.941799:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302565.965434:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302566.764183:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302566.764224:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302566.764254:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302566.764342:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484192640 00000100:00100000:3.0:1789302566.764351:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484192640 00000100:00100000:3.0:1789302566.764406:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484192512 00000100:00100000:3.0:1789302566.764409:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484192512 00000100:00100000:3.0:1789302566.764432:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:3.0:1789302566.764442:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484192640:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302566.764513:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484192640:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 71us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302566.764520:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:3.0:1789302566.764536:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00100000:3.0:1789302566.764543:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484192512:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302566.764568:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484192512:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302566.764574:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00080000:3.0:1789302566.764589:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302566.765039:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484192384 00000100:00100000:1.0:1789302566.765046:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484192384 00000100:00100000:1.0:1789302566.765092:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 246 00000100:00100000:1.0:1789302566.765101:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484192384:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302566.765363:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484192384:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 263us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302566.765371:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 246 00010000:00010000:1.0:1789302566.993544:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789302567.211420:0:11376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789302568.013551:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302568.333819:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505198720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302568.333906:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302568.334271:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505198720 00000100:00100000:0.0:1789302568.334280:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505198720 00000100:00100000:0.0:1789302568.334373:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789302568.334383:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505198720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302568.334432:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789302568.334547:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302568.334691:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505198720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 309us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302568.334700:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789302568.337867:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936c51180 x1876219505198720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302568.337898:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505198720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302568.846275:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789302568.846338:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505198848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302568.846434:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302568.846546:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505198848 00000100:00100000:3.0:1789302568.846558:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505198848 00000100:00100000:3.0:1789302568.846665:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789302568.846677:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505198848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302568.846721:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789302568.846954:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789302568.846990:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6902ead180 x1876219505198848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302568.847013:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505198848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302568.847036:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505198848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302568.847045:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789302568.847718:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505199360:0@lo:400:kworker.0 00000100:00100000:1.0:1789302568.847743:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505199104:0@lo:400:kworker.0 00000100:00100000:3.0:1789302568.847771:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302568.847774:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302568.847806:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302568.847812:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505199232:0@lo:400:kworker.0 00000100:00100000:1.0:1789302568.847834:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302568.847968:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505199104 00000100:00100000:1.0:1789302568.847976:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505199104 00000100:00100000:1.0:1789302568.848019:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505199232 00000100:00100000:1.0:1789302568.848023:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505199232 00000100:00100000:1.0:1789302568.848054:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789302568.848078:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505199104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302568.848102:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789302568.848108:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505198976:0@lo:400:kworker.0 00000100:00100000:1.0:1789302568.848122:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505199104:12345-0@lo:400:kworker.0 Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302568.848129:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789302568.848136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302568.848157:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789302568.848163:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505199488:0@lo:400:kworker.0 00000100:00100000:1.0:1789302568.848165:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505199232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302568.848185:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302568.848188:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505199232:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302568.848194:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789302568.848203:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505199488 00000100:00100000:1.0:1789302568.848206:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505199488 00000100:00100000:3.0:1789302568.848209:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505199360 00000100:00100000:3.0:1789302568.848212:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505199360 00000100:00100000:1.0:1789302568.848222:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789302568.848227:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505199488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302568.848237:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302568.848242:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505199360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302568.848272:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505199488:12345-0@lo:400:kworker.0 Request processed in 44us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302568.848279:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789302568.848282:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505199360:12345-0@lo:400:kworker.0 Request processed in 41us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302568.848316:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302568.848332:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505198976 00000100:00100000:3.0:1789302568.848336:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505198976 00000100:00080000:1.0:1789302568.848337:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302568.848361:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505199232:0@lo:400:kworker.0 00000100:00100000:1.0:1789302568.848372:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505199104:0@lo:400:kworker.0 00000100:00100000:1.0:1789302568.848396:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505199488:0@lo:400:kworker.0 00010000:00080000:1.0:1789302568.848408:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6902eadc00 x1876219505199360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302568.848417:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505199360:0@lo:400:kworker.0 00000100:00100000:3.0:1789302568.850680:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789302568.850696:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505198976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302568.850827:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505198976:12345-0@lo:400:kworker.0 Request processed in 134us (2688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302568.850857:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789302568.851417:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505198976:0@lo:400:kworker.0 00010000:00010000:2.0:1789302569.037792:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302570.061508:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302570.801492:0:11475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:29:28 (1789302568) === 00000100:00100000:3.0:1789302571.070749:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302571.070813:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.070890:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484192768 00000100:00100000:2.0:1789302571.070903:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484192768 00000100:00100000:2.0:1789302571.070994:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:2.0:1789302571.071008:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484192768:12345-192.168.203.42@tcp:41:mkdir.0 00000004:00000024:2.0:1789302571.071069:0:9859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789302571.071183:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484192768:12345-192.168.203.42@tcp:41:mkdir.0 Request processed in 178us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.071191:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:0.0:1789302571.071618:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484192896 00000100:00100000:0.0:1789302571.071624:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484192896 00000100:00100000:0.0:1789302571.071668:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:0.0:1789302571.071676:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ace2f696-3715-4928-b36c-02db3411d1a3+6:9704:x1876219484192896:12345-192.168.203.42@tcp:700:mkdir.0 00000100:00100000:0.0:1789302571.071726:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ace2f696-3715-4928-b36c-02db3411d1a3+6:9704:x1876219484192896:12345-192.168.203.42@tcp:700:mkdir.0 Request processed in 50us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302571.071733:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00080000:3.0:1789302571.071859:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302571.074055:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302571.078659:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484193152 00000100:00100000:0.0:1789302571.078681:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484193152 00000100:00100000:0.0:1789302571.078769:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:0.0:1789302571.078783:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:9704:x1876219484193152:12345-192.168.203.42@tcp:36:mkdir.0 00010000:00010000:0.0:1789302571.078856:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302571.082101:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6900030000/0x20be524657f11521 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3587 expref: 6 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.082135:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:0.0:1789302571.082155:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302571.082941:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.082970:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.082997:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.085664:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302571.086261:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.086506:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.086524:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302571.096168:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789302571.096195:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.096210:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.096219:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.096226:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302571.096242:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.096251:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.096281:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:2.0:1789302571.096328:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302571.096335:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.096343:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11640 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302571.096961:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b32c8a8a reply state 00000000650a5c68 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302571.096975:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302571.097204:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:9704:x1876219484193152:12345-192.168.203.42@tcp:36:mkdir.0 Request processed in 18417us (23155us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789302571.097214:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00010000:00010000:0.0:1789302571.106650:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.106676:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.106685:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.106692:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302571.106698:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.106708:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.106728:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69051aff00) 00010000:00010000:0.0:1789302571.106732:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302571.106739:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.106747:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11647 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302571.114332:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.114513:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484193280 00000100:00100000:2.0:1789302571.114527:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484193280 00000100:00100000:2.0:1789302571.114619:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:2.0:1789302571.114633:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:9705:x1876219484193280:12345-192.168.203.42@tcp:101:chmod.0 00010000:00010000:2.0:1789302571.114662:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302571.114691:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1164e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b360c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.114777:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11655 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.114795:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.114810:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302571.114854:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789302571.114858:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302571.114909:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.114969:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1164e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b360c expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.114994:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11655 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b360c expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.115003:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68400) 00010000:00010000:2.0:1789302571.115006:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302571.115011:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9400, rc 0) 00000100:00100000:2.0:1789302571.115103:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:9705:x1876219484193280:12345-192.168.203.42@tcp:101:chmod.0 Request processed in 473us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.115111:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:2.0:1789302571.123087:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302571.123215:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484193536 00000100:00100000:1.0:1789302571.123244:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484193536 00000100:00100000:1.0:1789302571.123698:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:1.0:1789302571.123722:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:9705:x1876219484193536:12345-192.168.203.42@tcp:36:chmod.0 00010000:00010000:1.0:1789302571.124086:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302571.124193:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11655 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b360c expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.124238:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68400) 00010000:00010000:1.0:1789302571.124253:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302571.126163:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.126200:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.126219:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302571.127761:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df007353 reply state 0000000090a1c2b2 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302571.127789:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789302571.127800:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789302571.128550:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+8:9705:x1876219484193536:12345-192.168.203.42@tcp:36:chmod.0 Request processed in 4832us (5470us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789302571.128577:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00010000:00010000:1.0:1789302571.132844:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.132869:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.132877:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.132884:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302571.132889:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.132917:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.132938:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69051af300) 00010000:00010000:1.0:1789302571.132942:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789302571.132948:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.132956:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1165c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302571.165901:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302571.168732:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484193664 00000100:00100000:1.0:1789302571.168754:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484193664 00000100:00100000:2.0:1789302571.170993:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:2.0:1789302571.171014:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:9706:x1876219484193664:12345-192.168.203.42@tcp:101:chown.0 00010000:00010000:2.0:1789302571.171062:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302571.171095:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3613 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.171195:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f1166a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.171214:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f1166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.171237:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f1166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302571.171312:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789302571.171317:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302571.171367:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f1166a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.171402:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3613 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.171425:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f1166a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3613 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.171458:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302571.171462:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302571.171466:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8200, rc 0) 00000100:00100000:2.0:1789302571.171560:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:9706:x1876219484193664:12345-192.168.203.42@tcp:101:chown.0 Request processed in 551us (5675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.171567:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789302571.175833:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302571.175931:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484193792 00000100:00100000:1.0:1789302571.175946:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484193792 00000100:00100000:1.0:1789302571.176025:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:1.0:1789302571.176037:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+8:9706:x1876219484193792:12345-192.168.203.42@tcp:101:chown.0 00010000:00010000:1.0:1789302571.176063:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302571.176090:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b361a expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176196:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176214:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176237:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176415:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176425:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176434:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176546:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176554:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176562:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302571.176597:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789302571.176602:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302571.176627:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176641:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176649:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176656:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176672:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302571.176677:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176686:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176701:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:1.0:1789302571.176705:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302571.176711:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176718:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176734:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176740:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176746:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176751:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302571.176754:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176759:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176776:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69051af300) 00010000:00010000:1.0:1789302571.176779:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302571.176782:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176788:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f1167f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176828:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b361a expref: 10 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176844:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b361a expref: 9 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.176852:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a69051af200) 00010000:00010000:1.0:1789302571.176854:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302571.176857:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c8c00, rc 0) 00000100:00100000:1.0:1789302571.176936:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+9:9706:x1876219484193792:12345-192.168.203.42@tcp:101:chown.0 Request processed in 901us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302571.176945:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:0.0:1789302571.179606:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.179711:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484194048 00000100:00100000:2.0:1789302571.179725:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484194048 00000100:00100000:2.0:1789302571.179834:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:2.0:1789302571.179846:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+9:9706:x1876219484194048:12345-192.168.203.42@tcp:36:chown.0 00010000:00010000:2.0:1789302571.179913:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302571.179945:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b361a expref: 9 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.179968:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a69051af200) 00010000:00010000:2.0:1789302571.179982:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302571.180017:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.180032:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.180044:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302571.215163:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c034a52 reply state 000000005193635c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302571.215207:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789302571.215236:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789302571.215422:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+10:9706:x1876219484194048:12345-192.168.203.42@tcp:36:chown.0 Request processed in 35570us (35821us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789302571.215434:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000001:00080000:3.0:1789302571.220014:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1789302571.220265:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.220317:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.220327:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.220359:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302571.220365:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.220376:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.220395:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68d00) 00010000:00010000:1.0:1789302571.220398:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789302571.220405:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.220411:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1168d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302571.242899:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302571.243650:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484194176 00000100:00100000:1.0:1789302571.243668:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484194176 00000100:00100000:1.0:1789302571.243792:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789302571.243806:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+6:9707:x1876219484194176:12345-192.168.203.42@tcp:101:touch.500 00010000:00010000:1.0:1789302571.243843:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302571.243874:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f11694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3621 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302571.247203:0:9859:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3257us 00010000:00010000:2.0:1789302571.261685:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.261715:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.261729:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.261749:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.261757:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.261763:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262715:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f116a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262729:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f116a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262753:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f116a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302571.262789:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789302571.262793:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302571.262843:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f116a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262860:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262868:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262876:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262883:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302571.262888:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262897:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262912:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302571.262916:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302571.262922:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262929:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1169b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262953:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262959:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262966:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262971:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302571.262974:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262981:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.262989:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6907c68500) 00010000:00010000:2.0:1789302571.262992:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302571.262996:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.263001:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.263062:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9800/0x20be524657f11694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3621 expref: 8 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.263080:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f116a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3621 expref: 7 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.263099:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:2.0:1789302571.263102:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789302571.263105:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9a00, rc 0) 00000100:00100000:2.0:1789302571.263670:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+7:9707:x1876219484194176:12345-192.168.203.42@tcp:101:touch.500 Request processed in 19863us (20784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.263681:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:0.0:1789302571.267501:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.267743:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484194432 00000100:00100000:2.0:1789302571.267757:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484194432 00000100:00100000:2.0:1789302571.267835:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:2.0:1789302571.267848:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:9707:x1876219484194432:12345-192.168.203.42@tcp:101:touch.500 00010000:00010000:2.0:1789302571.267881:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302571.267910:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9800/0x20be524657f116b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3628 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.268277:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.268336:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.268350:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.268370:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.268378:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.268399:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302571.269209:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789302571.269594:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f116c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269609:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f116c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269620:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f116c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269659:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269667:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269674:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269680:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302571.269686:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269695:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269709:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:2.0:1789302571.269712:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302571.269726:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269733:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f116b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302571.269747:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003acd0e89 reply state 00000000b6d68be8 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302571.269757:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789302571.269799:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9800/0x20be524657f116b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3628 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269818:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f116c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3628 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.269827:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6907c68400) 00010000:00010000:2.0:1789302571.269829:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302571.269832:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8400, rc 0) 00000100:00100000:2.0:1789302571.269919:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+10:9707:x1876219484194432:12345-192.168.203.42@tcp:101:touch.500 Request processed in 2072us (2432us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789302571.269928:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00010000:00010000:3.0:1789302571.272608:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.272637:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.272646:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.272651:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302571.272658:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.272666:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.272690:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6d52d3e0 (ffff9a6907c68c00) 00010000:00010000:3.0:1789302571.272693:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302571.272699:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.272728:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f116be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302571.275602:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.275735:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484194688 00000100:00100000:2.0:1789302571.275749:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484194688 00000100:00100000:2.0:1789302571.275823:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:2.0:1789302571.275837:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+9:9707:x1876219484194688:12345-192.168.203.42@tcp:36:touch.500 00010000:00010000:2.0:1789302571.275917:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302571.275953:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f116c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3628 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.275999:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6907c68400) 00010000:00010000:2.0:1789302571.276014:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302571.276067:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.276083:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.276095:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302571.276430:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000664f7011 reply state 00000000f3ccaa84 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302571.276443:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302571.276564:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+10:9707:x1876219484194688:12345-192.168.203.42@tcp:36:touch.500 Request processed in 730us (976us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789302571.276572:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00010000:00010000:0.0:1789302571.279509:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.279534:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.279544:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.279551:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302571.279557:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.279566:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.279587:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6907c68500) 00010000:00010000:0.0:1789302571.279591:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302571.279596:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.279603:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f116d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302571.281015:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.281103:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484194816 00000100:00100000:2.0:1789302571.281117:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484194816 00000100:00100000:2.0:1789302571.281199:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:2.0:1789302571.281214:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+9:9707:x1876219484194816:12345-192.168.203.42@tcp:101:touch.500 00010000:00010000:2.0:1789302571.281260:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302571.281340:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f116da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b362f expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.281462:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f116da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b362f expref: 10 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.281491:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f116da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b362f expref: 10 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.281515:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6907c68a00) 00010000:00010000:2.0:1789302571.281518:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302571.281522:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8800, rc 0) 00000100:00100000:2.0:1789302571.281589:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+10:9707:x1876219484194816:12345-192.168.203.42@tcp:101:touch.500 Request processed in 380us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.281596:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:1.0:1789302571.285786:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.285891:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484194944 00000100:00100000:2.0:1789302571.285905:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484194944 00000100:00100000:2.0:1789302571.286016:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:2.0:1789302571.286027:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876219484194944:12345-192.168.203.42@tcp:8:touch.500 00010000:00080000:2.0:1789302571.286072:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1789302571.286118:0:6699:0:(genops.c:1384:class_connect()) connect: client ace2f696-3715-4928-b36c-02db3411d1a3, cookie 0x20be524657f116e1 00002000:00100000:2.0:1789302571.286133:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ace2f696-3715-4928-b36c-02db3411d1a3/ffff9a693bc90000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789302571.286190:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789302571.286564:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789302571.286609:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a693bc92000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302571.286695:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2350:x1876219484194944:12345-192.168.203.42@tcp:8:touch.500 Request processed in 668us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.286705:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:1.0:1789302571.292143:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302571.292238:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484195072 00000100:00100000:3.0:1789302571.292251:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484195072 00000100:00100000:3.0:1789302571.292379:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:3.0:1789302571.292391:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:0:x1876219484195072:12345-192.168.203.42@tcp:2:touch.500 00000100:00080000:1.0:1789302571.292812:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789302571.331915:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000001:00080000:0.0:1789302571.331939:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789302571.332197:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+5:0:x1876219484195072:12345-192.168.203.42@tcp:2:touch.500 Request processed in 39799us (40060us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789302571.332211:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:3.0:1789302571.337313:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302571.338742:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484195328 00000100:00100000:1.0:1789302571.338762:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484195328 00000100:00100000:2.0:1789302571.338989:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:2.0:1789302571.339002:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+10:9707:x1876219484195328:12345-192.168.203.42@tcp:35:touch.500 00000100:00100000:2.0:1789302571.339551:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+11:9707:x1876219484195328:12345-192.168.203.42@tcp:35:touch.500 Request processed in 550us (2269us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789302571.339561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:1.0:1789302571.362098:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302571.362241:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484195456 00000100:00100000:3.0:1789302571.362256:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484195456 00000100:00100000:2.0:1789302571.363184:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:2.0:1789302571.363206:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+11:9708:x1876219484195456:12345-192.168.203.42@tcp:101:rm.0 00010000:00010000:2.0:1789302571.363250:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302571.363278:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f116e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3636 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.363408:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9800/0x20be524657f116ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.363432:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9800/0x20be524657f116ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.363448:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9800/0x20be524657f116ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302571.363492:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789302571.363497:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302571.363545:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9800/0x20be524657f116ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.363578:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f116e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3636 expref: 13 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.363600:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9800/0x20be524657f116ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3636 expref: 12 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302571.363627:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:2.0:1789302571.363631:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302571.363635:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9800, rc 0) 00000100:00100000:2.0:1789302571.363731:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+12:9708:x1876219484195456:12345-192.168.203.42@tcp:101:rm.0 Request processed in 532us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.363739:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:1.0:1789302571.371084:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302571.371280:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484195712 00000100:00100000:3.0:1789302571.371337:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484195712 00000100:00100000:3.0:1789302571.371435:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:3.0:1789302571.371451:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+12:9708:x1876219484195712:12345-192.168.203.42@tcp:101:rm.0 00010000:00010000:3.0:1789302571.371482:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302571.371510:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f116f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b363d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302571.371637:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789302571.371875:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f116f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b363d expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.371892:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:3.0:1789302571.371902:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302571.371909:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f116f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b363d expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.371927:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6a00, rc 0) 00000100:00100000:3.0:1789302571.372006:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+13:9708:x1876219484195712:12345-192.168.203.42@tcp:101:rm.0 Request processed in 560us (938us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789302571.372015:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:1.0:1789302571.382145:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.382774:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484195840 00000100:00100000:2.0:1789302571.382790:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484195840 00000100:00100000:2.0:1789302571.383012:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:2.0:1789302571.383029:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:9708:x1876219484195840:12345-192.168.203.42@tcp:37:rm.0 00000100:00100000:2.0:1789302571.395060:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:9708:x1876219484195840:12345-192.168.203.42@tcp:37:rm.0 Request processed in 12016us (12917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.395079:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:0.0:1789302571.398256:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302571.398434:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484196096 00000100:00100000:3.0:1789302571.398451:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484196096 00000100:00100000:3.0:1789302571.398532:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:3.0:1789302571.398545:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690631dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+13:9708:x1876219484196096:12345-192.168.203.42@tcp:35:rm.0 00000100:00100000:3.0:1789302571.398867:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690631dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+14:9708:x1876219484196096:12345-192.168.203.42@tcp:35:rm.0 Request processed in 324us (625us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789302571.398875:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789302571.404945:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302571.405092:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484196352 00000100:00100000:0.0:1789302571.405105:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484196352 00000100:00100000:0.0:1789302571.405216:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:0.0:1789302571.405236:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+14:9708:x1876219484196352:12345-192.168.203.42@tcp:101:rm.0 00010000:00010000:0.0:1789302571.405458:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302571.405488:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3644 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.405616:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f1170b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.405635:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f1170b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.405649:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f1170b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302571.405661:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789302571.406591:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3644 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.406628:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f1170b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3644 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.407017:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302571.407022:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789302571.407028:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044a00, rc 0) 00000100:00100000:0.0:1789302571.407127:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+16:9708:x1876219484196352:12345-192.168.203.42@tcp:101:rm.0 Request processed in 1899us (2196us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789302571.407145:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:1.0:1789302571.411739:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302571.416421:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484196480 00000100:00100000:0.0:1789302571.416471:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484196480 00000100:00100000:0.0:1789302571.416556:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:0.0:1789302571.416569:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:9708:x1876219484196480:12345-192.168.203.42@tcp:41:rm.0 00000004:00000024:0.0:1789302571.416802:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789302571.417102:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:9708:x1876219484196480:12345-192.168.203.42@tcp:41:rm.0 Request processed in 533us (5377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302571.417112:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:1.0:1789302571.425047:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302571.425146:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484196608 00000100:00100000:3.0:1789302571.425161:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484196608 00000100:00100000:3.0:1789302571.425255:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:3.0:1789302571.425267:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+16:9708:x1876219484196608:12345-192.168.203.42@tcp:101:rm.0 00010000:00010000:3.0:1789302571.425330:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302571.425359:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b364b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425466:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425484:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425529:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425549:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425557:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425564:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425691:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1172e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425700:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1172e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425707:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1172e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302571.425949:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789302571.425954:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302571.425980:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1172e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.425995:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1172e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426005:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426023:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426031:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426038:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302571.426043:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426051:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426066:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:3.0:1789302571.426069:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302571.426076:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426083:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f11720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426101:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426107:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426113:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426118:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302571.426129:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426136:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426145:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6d52d3e0 (ffff9a6904039400) 00010000:00010000:3.0:1789302571.426148:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302571.426151:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426157:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426207:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b364b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426222:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1172e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b364b expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.426239:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6907c68a00) 00010000:00010000:3.0:1789302571.426241:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302571.426244:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:3.0:1789302571.426529:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+17:9708:x1876219484196608:12345-192.168.203.42@tcp:101:rm.0 Request processed in 1262us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302571.426539:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:1.0:1789302571.438767:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302571.439108:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484196864 00000100:00100000:0.0:1789302571.439121:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484196864 00000100:00100000:0.0:1789302571.439207:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789302571.439219:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+17:9708:x1876219484196864:12345-192.168.203.42@tcp:36:rm.0 00010000:00010000:0.0:1789302571.439349:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789302571.439386:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1172e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b364b expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439423:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f116da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b362f expref: 16 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439435:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6907c68a00) 00010000:00010000:0.0:1789302571.439454:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9800/0x20be524657f116ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3636 expref: 15 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439463:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302571.439466:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302571.439494:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439510:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439543:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439561:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439569:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439576:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439711:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439720:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.439727:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302571.441403:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789302571.441421:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 282627134559ns, next at 283627130648ns, rc = 0 00010000:00010000:0.0:1789302571.441518:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441536:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441547:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441570:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441578:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441584:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441618:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302571.441644:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441650:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441657:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441663:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302571.441668:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441676:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441690:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a69061a7600) 00010000:00010000:0.0:1789302571.441693:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789302571.441699:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441715:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11743 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441738:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441744:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441749:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441755:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302571.441758:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441764:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441772:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302571.441775:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302571.441778:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.441783:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302571.441794:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024c3156f reply state 000000002ec4f46a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302571.441805:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302571.441932:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+16:9708:x1876219484196864:12345-192.168.203.42@tcp:36:rm.0 Request processed in 2712us (3175us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789302571.441943:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00010000:00010000:1.0:1789302571.445118:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302571.445144:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.445156:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302571.445160:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.445172:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.445203:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a69061a7600) 00010000:00010000:1.0:1789302571.445206:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789302571.445212:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.445218:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f1174a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302571.445256:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302571.445258:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302571.445260:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302571.446782:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302571.447089:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484197120 00000100:00100000:1.0:1789302571.447103:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484197120 00000100:00100000:1.0:1789302571.447204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:1.0:1789302571.447217:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:9708:x1876219484197120:12345-192.168.203.42@tcp:35:rm.0 00000100:00100000:1.0:1789302571.447601:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+17:9708:x1876219484197120:12345-192.168.203.42@tcp:35:rm.0 Request processed in 385us (830us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789302571.447610:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00010000:00010000:3.0:1789302571.448596:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.448614:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.448643:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.448650:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302571.448655:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.448666:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.448686:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6d52d3e0 (ffff9a69061a7b00) 00010000:00010000:3.0:1789302571.448689:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302571.448695:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302571.448702:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1173c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6d52d3e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302571.450195:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302571.450960:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484197376 00000100:00100000:0.0:1789302571.450974:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484197376 00000100:00100000:0.0:1789302571.451053:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:0.0:1789302571.451065:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:9708:x1876219484197376:12345-192.168.203.42@tcp:36:rm.0 00010000:00010000:0.0:1789302571.451152:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789302571.451187:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f1170b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3644 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.451214:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f116a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3621 expref: 15 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.451237:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302571.451255:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f1166a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3613 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.451265:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302571.451492:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302571.451525:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.451543:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.451555:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.451596:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.451604:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.451610:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.452195:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.452206:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.452215:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302571.453903:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789302571.453931:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.453942:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.453950:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.453957:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302571.453963:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.453988:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454008:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a69061a7300) 00010000:00010000:0.0:1789302571.454012:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789302571.454018:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454025:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1175f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454055:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454062:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454068:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454073:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302571.454076:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454083:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454091:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69061a7d00) 00010000:00010000:0.0:1789302571.454092:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302571.454095:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.454111:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f11751 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302571.454744:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1e175da reply state 00000000f174deac transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302571.454760:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302571.454968:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+15:9708:x1876219484197376:12345-192.168.203.42@tcp:36:rm.0 Request processed in 3897us (4785us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789302571.454978:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00010000:00010000:0.0:1789302571.468899:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.468923:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.468932:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.468939:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302571.468945:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.468955:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.468977:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a69061a7200) 00010000:00010000:0.0:1789302571.468982:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302571.468988:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302571.469021:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f11758 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302571.884463:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302571.884519:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302571.884892:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484197504 00000100:00100000:2.0:1789302571.884905:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484197504 00000100:00100000:2.0:1789302571.884978:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 248 00000100:00100000:2.0:1789302571.884989:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484197504:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302571.885082:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484197504:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 94us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302571.885090:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 248 00000100:00100000:0.0:1789302571.885855:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484197632 00000100:00100000:0.0:1789302571.885865:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484197632 00000100:00100000:0.0:1789302571.885941:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:0.0:1789302571.885951:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484197632:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302571.886023:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484197632:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 73us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302571.886031:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00080000:1.0:1789302571.886111:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302572.110199:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302573.139262:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302573.460227:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505199616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302573.460370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302573.460609:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505199616 00000100:00100000:0.0:1789302573.460622:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505199616 00000100:00100000:0.0:1789302573.460715:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789302573.460728:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505199616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302573.460775:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302573.460831:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505199616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302573.460840:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789302573.460929:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302573.462504:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6902eac380 x1876219505199616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302573.462555:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505199616:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789302573.966799:0:8019:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 285152509590ns, next at 286152506208ns, rc = 0 00000100:00100000:1.0:1789302573.966922:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505199744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302573.967009:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302573.967384:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505200256:0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.967423:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302573.967453:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302573.967460:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505200128:0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.967488:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302573.967523:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505199872:0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.967554:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302573.967578:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693632b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505200384:0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.967621:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302573.967647:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789302573.967653:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693632b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505200000:0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.967675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302573.967694:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505200512:0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.967714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302573.967749:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505199744 00000100:00100000:1.0:1789302573.967759:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505199744 00000100:00100000:1.0:1789302573.967828:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302573.967840:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505199744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302573.967891:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302573.967943:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505199744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302573.967950:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789302573.967978:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505200256 00000100:00100000:1.0:1789302573.967982:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505200256 00000100:00100000:1.0:1789302573.968009:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505200512 00000100:00100000:1.0:1789302573.968012:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505200512 00000100:00100000:1.0:1789302573.968031:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789302573.968038:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69363f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505200256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.969511:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69363f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505200256:12345-0@lo:400:kworker.0 Request processed in 1460us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302573.969525:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789302573.969791:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789302573.969808:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505200512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.969895:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505200512:12345-0@lo:400:kworker.0 Request processed in 95us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302573.969901:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789302573.969935:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505200128 00000100:00100000:1.0:1789302573.969943:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505200128 00000100:00100000:1.0:1789302573.969989:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505200384 00000100:00100000:1.0:1789302573.969991:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505200384 00000100:00100000:1.0:1789302573.970008:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505200000 00000100:00100000:1.0:1789302573.970011:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505200000 00000100:00100000:1.0:1789302573.970026:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789302573.970033:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505200128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.970067:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505200128:12345-0@lo:400:kworker.0 Request processed in 34us (2577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302573.970090:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789302573.970103:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789302573.970109:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505200384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.970138:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505200384:12345-0@lo:400:kworker.0 Request processed in 30us (2515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302573.970143:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789302573.970154:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302573.970160:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505200000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.970184:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505200000:12345-0@lo:400:kworker.0 Request processed in 24us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302573.970189:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789302573.970222:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505199872 00000100:00100000:1.0:1789302573.970226:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505199872 00000100:00100000:1.0:1789302573.970265:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789302573.970272:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505199872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302573.972000:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505199872:12345-0@lo:400:kworker.0 Request processed in 1719us (4435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302573.972013:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:1.0:1789302573.972089:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302573.972096:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302573.972145:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505200128:0@lo:400:kworker.0 00010000:00080000:1.0:1789302573.972165:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936329c00 x1876219505199744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302573.972184:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505199744:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789302573.972225:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6936328e00 x1876219505200256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302573.972234:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505200256:0@lo:400:kworker.0 00000100:00100000:0.0:1789302573.972782:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693632b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505200000:0@lo:400:kworker.0 00010000:00080000:0.0:1789302573.972803:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c334a80 x1876219505200512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302573.972813:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505200512:0@lo:400:kworker.0 00000100:00100000:0.0:1789302573.972823:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505199872:0@lo:400:kworker.0 00000100:00100000:0.0:1789302573.972834:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693632b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505200384:0@lo:400:kworker.0 00010000:00010000:3.0:1789302574.159431:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302575.181520:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789302575.644855:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1789302576.214306:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789302576.576410:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1789302576.576433:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:3.0:1789302576.576460:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1789302576.576959:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302576.576988:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505200640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789302576.577080:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302576.577512:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505200640 00000100:00100000:2.0:1789302576.577523:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505200640 00000100:00100000:2.0:1789302576.577621:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302576.577633:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505200640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789302576.577669:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789302576.577716:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa6972a, atime: 0x6aa6972a, ctime: 0x6aa6972a, blocks: 0x1 00010000:00010000:2.0:1789302576.577727:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.577748:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1789302576.577753:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302576.577761:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.577782:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.577794:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.577804:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.577838:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789302576.578610:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876219505200640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 975us (1525us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789302576.578622:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789302576.578661:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302576.578671:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.578681:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302576.578686:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.578697:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.578717:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.578725:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9dbf48e/0x20be524657f11766 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.578749:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302576.578751:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302576.578753:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789302576.578798:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6902ead180/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789302576.578805:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505200640:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1789302576.578959:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789302576.797628:0:11676:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc923e8680 20000000:00000080:3.0:1789302576.797657:0:11676:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6903285400 uarg=0000000000000000 20000000:01000000:3.0:1789302576.797707:0:11676:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789302576.797715:0:11676:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789302576.797906:0:11676:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789302576.799380:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789302576.799656:0:11676:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789302576.807546:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789302576.807623:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789302576.807684:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789302576.807703:0:11676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789302576.807738:0:11676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.807765:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11608 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.807775:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11616 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.807784:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11624 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.807796:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.807805:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.807812:0:11676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.807880:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.807912:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 12 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.807930:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505200768:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302576.808060:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.808069:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 12 pid: 5839 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.808079:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505200896:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302576.808116:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f11624 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.808125:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f11624 expref: 18 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.808136:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505201024:0@lo:104: 00000100:00100000:0.0:1789302576.808213:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302576.808266:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f11616 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.808277:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f11616 expref: 18 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.808312:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505201152:0@lo:104: 00000100:00100000:2.0:1789302576.808317:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505201024 00000100:00100000:2.0:1789302576.808329:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505201024 00000100:00100000:0.0:1789302576.808340:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302576.808386:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505201152 00010000:00010000:0.0:1789302576.808389:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f11608 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302576.808390:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505201152 00010000:00010000:0.0:1789302576.808402:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f11608 expref: 18 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302576.808411:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302576.808415:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505201280:0@lo:104: 00000100:00100000:2.0:1789302576.808426:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:11676:x1876219505201024:12345-0@lo:104: 00010000:00010000:2.0:1789302576.808443:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.808444:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302576.808457:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad480 going to sleep for 11 seconds 00010000:00010000:2.0:1789302576.808529:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789302576.808536:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:11676:x1876219505201024:12345-0@lo:104: Request processed in 115us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302576.808543:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789302576.808569:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789302576.808579:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505201280 00000100:00100000:2.0:1789302576.808582:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505201280 00000100:00100000:2.0:1789302576.808596:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302576.808601:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:11676:x1876219505201152:12345-0@lo:104: 00010000:00010000:2.0:1789302576.808609:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.808642:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789302576.808647:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+4:11676:x1876219505201152:12345-0@lo:104: Request processed in 46us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302576.808653:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789302576.808664:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302576.808669:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935f99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:11676:x1876219505201280:12345-0@lo:104: 00010000:00010000:2.0:1789302576.808676:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302576.808699:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302576.808708:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.808711:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789302576.808717:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6923abfe00 already unused, calling callback (ffffffffc1a60c20) 00000100:00100000:2.0:1789302576.808721:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935f99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8df8e325-951a-4604-89fa-82b64ca867d0+3:11676:x1876219505201280:12345-0@lo:104: Request processed in 51us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302576.808727:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789302576.808769:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302576.808775:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.808781:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505201024:0@lo:104: 00010000:00010000:2.0:1789302576.808786:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6923abfc00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302576.808791:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.808796:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505201152:0@lo:104: 10000000:00010000:3.0:1789302576.808800:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.808806:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302576.808811:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.808813:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505201280:0@lo:104: 10000000:00010000:2.0:1789302576.808816:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302576.808825:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302576.808827:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789302576.808831:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789302576.808859:0:8459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.808866:0:8459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302576.808889:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.808896:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6923abfc00/0x20be524657f11616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1161d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302576.808899:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505201408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302576.808907:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302576.808910:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.808925:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7c00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302576.808928:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302576.808935:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302576.808936:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302576.808943:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302576.808949:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302576.813059:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302576.813081:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302576.813124:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302576.813133:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6923abfe00/0x20be524657f11624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1162b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.813154:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505201536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302576.813182:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302576.813185:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302576.813200:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302576.813211:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302576.813238:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505201408 00000100:00100000:3.0:1789302576.813248:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505201408 00000100:00100000:0.0:1789302576.813262:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789302576.813315:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11616 expref: 19 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302576.813352:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505201536 00000100:00100000:3.0:1789302576.813356:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505201536 00000100:00100000:0.0:1789302576.813363:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789302576.813372:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11624 expref: 20 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.813379:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8df8e325-951a-4604-89fa-82b64ca867d0+20:3304:x1876219505201408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302576.813399:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789302576.813400:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789302576.813409:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11616 expref: 20 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.813425:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f11616 expref: 20 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302576.813432:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+20:3305:x1876219505201536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302576.813445:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302576.813450:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abf000/0x20be524657f1161d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f11616 expref: 20 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302576.813451:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11624 expref: 20 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302576.813475:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f11624 expref: 19 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.813494:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302576.813500:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba6800/0x20be524657f1162b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f11624 expref: 19 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302576.813510:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302576.813547:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8df8e325-951a-4604-89fa-82b64ca867d0+18:3304:x1876219505201408:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (4610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302576.813560:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8df8e325-951a-4604-89fa-82b64ca867d0+18:3305:x1876219505201536:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302576.813567:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789302576.813580:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789302576.813640:0:8459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302576.813646:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505201536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302576.813654:0:8459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302576.813677:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302576.813678:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302576.813690:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505201664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302576.813690:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba7c00/0x20be524657f11608 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1160f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.813720:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302576.813723:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302576.813725:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302576.813735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302576.813866:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505201664 00000100:00100000:0.0:1789302576.813983:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505201664 00010000:00010000:0.0:1789302576.814001:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11608 expref: 17 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302576.814027:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789302576.814034:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690bb72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8df8e325-951a-4604-89fa-82b64ca867d0+17:3305:x1876219505201664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302576.814043:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302576.814047:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f11608 expref: 17 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.814056:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f11608 expref: 17 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.814068:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abec00/0x20be524657f1160f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f11608 expref: 17 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302576.814089:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302576.814116:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690bb72c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8df8e325-951a-4604-89fa-82b64ca867d0+16:3305:x1876219505201664:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302576.814123:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302576.814797:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505201664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302576.815396:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505201408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302576.823175:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302576.823306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302576.823401:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505200768:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302576.823436:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eac000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1876219505200896:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302576.823487:0:11676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302576.824199:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484197760 00000100:00100000:2.0:1789302576.824211:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484197760 00010000:00010000:2.0:1789302576.824263:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 13 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302576.824324:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484197888 00000100:00100000:2.0:1789302576.824328:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484197888 00010000:00010000:2.0:1789302576.824341:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 14 pid: 5839 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302576.824517:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:2.0:1789302576.824531:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+14:2351:x1876219484197760:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302576.824551:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302576.824558:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 14 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.824594:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 14 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.824618:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6942044000/0x20be524657f11639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3605 expref: 14 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.824638:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302576.824711:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484197760:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 184us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302576.824720:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:2.0:1789302576.824815:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:2.0:1789302576.824822:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:2351:x1876219484197888:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302576.824971:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302576.825276:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 12 pid: 5839 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825313:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 12 pid: 5839 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825325:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7000/0x20be524657f11632 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35fe expref: 12 pid: 5839 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825340:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825349:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825381:0:6712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825389:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825395:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825402:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825626:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302576.825631:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825641:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825657:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302576.825668:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302576.825705:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:2351:x1876219484197888:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 883us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302576.825713:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00010000:00010000:1.0:1789302576.825912:0:11676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302576.825921:0:11676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302576.825928:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6942045000/0x20be524657f1176d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302577.006759:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302577.006807:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302577.006839:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302577.006875:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484198016 00000100:00100000:3.0:1789302577.006887:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484198016 00000100:00100000:3.0:1789302577.006968:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484198272 00000100:00100000:3.0:1789302577.006973:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484198272 00000100:00100000:3.0:1789302577.007008:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:3.0:1789302577.007019:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2351:x1876219484198016:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302577.007126:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2351:x1876219484198016:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 108us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302577.007135:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:3.0:1789302577.007159:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 105 00000100:00100000:3.0:1789302577.007167:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484198272:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302577.007211:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484198272:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 45us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302577.007222:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 105 00000100:00100000:3.0:1789302577.007975:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484198144 00000100:00100000:3.0:1789302577.007997:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484198144 00000100:00100000:3.0:1789302577.008064:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:3.0:1789302577.008074:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484198144:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302577.008124:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484198144:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 51us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302577.008132:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00080000:3.0:1789302577.008164:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302577.008170:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302577.230498:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302577.835454:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302577.835686:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484198400 00000100:00100000:0.0:1789302577.835701:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484198400 00000100:00100000:0.0:1789302577.835784:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 250 00000100:00100000:0.0:1789302577.835798:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:5594:x1876219484198400:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302577.835820:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302577.835849:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6942044a00/0x20be524657f11774 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3652 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302577.835886:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6942044a00/0x20be524657f11774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3652 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302577.835900:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6942044a00/0x20be524657f11774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3652 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302577.835910:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044a00, rc 0) 00000100:00100000:0.0:1789302577.835989:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484198400:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 194us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302577.835997:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 250 00000100:00100000:0.0:1789302577.838467:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302577.838636:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484198528 00000100:00100000:1.0:1789302577.838648:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484198528 00000100:00100000:1.0:1789302577.838717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 251 00000100:00100000:1.0:1789302577.838729:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484198528:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302577.839129:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484198528:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 399us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302577.839151:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 251 00000100:00100000:3.0:1789302577.841453:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302577.843730:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484198656 00000100:00100000:1.0:1789302577.843749:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484198656 00000100:00100000:1.0:1789302577.843852:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 252 00000100:00100000:1.0:1789302577.843866:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484198656:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302577.844862:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484198656:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 992us (3416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302577.844876:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 252 00000100:00100000:3.0:1789302577.849923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302577.850048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484198784 00000100:00100000:0.0:1789302577.850061:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484198784 00000100:00100000:0.0:1789302577.850214:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 253 00000100:00100000:0.0:1789302577.850283:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:9978:x1876219484198784:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302577.850791:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:9978:x1876219484198784:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 565us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302577.850801:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 253 00000100:00100000:0.0:1789302577.859582:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302577.859809:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484198912 00000100:00100000:1.0:1789302577.859822:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484198912 00000100:00100000:1.0:1789302577.859899:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 254 00000100:00100000:1.0:1789302577.859912:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:9978:x1876219484198912:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789302577.860725:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:9978:x1876219484198912:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 810us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302577.860737:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 254 00000100:00100000:3.0:1789302577.892975:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302577.893196:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484199040 00000100:00100000:0.0:1789302577.893210:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484199040 00000100:00100000:0.0:1789302577.893337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 255 00000100:00100000:0.0:1789302577.893350:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:5594:x1876219484199040:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302577.893374:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302577.893397:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6942044400/0x20be524657f1177b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3659 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302577.893434:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6942044400/0x20be524657f1177b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3659 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302577.893446:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6942044400/0x20be524657f1177b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3659 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302577.893458:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044400, rc 0) 00000100:00100000:0.0:1789302577.893793:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484199040:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 444us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302577.893801:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 255 00000100:00100000:3.0:1789302577.895562:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302577.896159:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484199168 00000100:00100000:1.0:1789302577.896171:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484199168 00000100:00100000:1.0:1789302577.896263:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 256 00000100:00100000:1.0:1789302577.896274:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484199168:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302577.897075:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484199168:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 797us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302577.897087:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 256 00000100:00100000:3.0:1789302577.916471:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302577.917162:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484199296 00000100:00100000:0.0:1789302577.917175:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484199296 00000100:00100000:0.0:1789302577.917595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 257 00000100:00100000:0.0:1789302577.917608:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484199296:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302577.917889:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:5594:x1876219484199296:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 283us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302577.917897:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 257 00000100:00100000:2.0:1789302577.925544:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302577.926024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484199424 00000100:00100000:1.0:1789302577.926039:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484199424 00000100:00100000:1.0:1789302577.926171:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 258 00000100:00100000:1.0:1789302577.926192:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:9981:x1876219484199424:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789302577.926672:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:9981:x1876219484199424:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 490us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302577.926681:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 258 00000100:00100000:3.0:1789302577.929842:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302577.929960:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484199552 00000100:00100000:0.0:1789302577.929973:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484199552 00000100:00100000:0.0:1789302577.930120:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 259 00000100:00100000:0.0:1789302577.930132:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:9981:x1876219484199552:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302577.930923:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:9981:x1876219484199552:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 789us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302577.930944:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 259 00010000:00010000:3.0:1789302578.253755:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302578.573714:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302578.573801:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505201792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302578.573913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302578.574058:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505201792 00000100:00100000:1.0:1789302578.574069:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505201792 00000100:00100000:1.0:1789302578.574149:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789302578.574163:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505201792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302578.574216:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302578.574267:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505201792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302578.574274:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789302578.574353:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789302578.574390:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c72aa00 x1876219505201792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302578.574411:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505201792:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1789302578.765431:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789302578.765442:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6936077800 from 7 10000000:01000000:0.0:1789302578.765449:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302578.765520:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302578.765534:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302578.765548:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302578.765585:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505201920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789302578.765684:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302578.765763:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b59300 going to sleep for 11 seconds 00000100:00100000:1.0:1789302578.765859:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505201920 00000100:00100000:1.0:1789302578.765871:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505201920 00000100:00100000:1.0:1789302578.765954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789302578.765965:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+16:5842:x1876219505201920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302578.765983:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302578.766000:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c8800/0x20be524657f11789 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11782 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.766030:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c8800/0x20be524657f11789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11782 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.766043:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c8800/0x20be524657f11789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11782 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.766052:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c8800, rc 0) 00000100:00100000:1.0:1789302578.766129:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505201920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302578.766135:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789302578.766347:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505201920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302578.766364:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302578.766385:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302578.766455:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302578.766484:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302578.766521:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b59300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302578.766593:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505202048 00000100:00100000:2.0:1789302578.766600:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505202048 00000100:00100000:2.0:1789302578.766639:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789302578.766646:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505202048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302578.766973:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505202048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302578.766981:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789302578.767150:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302578.767194:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302578.767236:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302578.767261:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b59300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302578.767528:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505202176 00000100:00100000:2.0:1789302578.767535:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505202176 00000100:00100000:2.0:1789302578.767571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789302578.767579:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505202176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302578.767764:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505202176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302578.767771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789302578.767851:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302578.768407:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11689:1876219505202304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302578.768454:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302578.768492:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b59e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302578.768549:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505202304 00000100:00100000:1.0:1789302578.768555:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505202304 00000100:00100000:1.0:1789302578.768595:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789302578.768604:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:11689:x1876219505202304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302578.768805:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+17:11689:x1876219505202304:12345-0@lo:502:llog_process_th.0 Request processed in 202us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302578.768814:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789302578.769041:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11689:1876219505202304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302578.769069:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302578.769082:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302578.769084:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789302578.769091:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6936077800 00000020:00000080:0.0:1789302578.769094:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789302578.769197:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11689:1876219505202432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302578.769249:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302578.769277:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b59e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302578.770336:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505202432 00000100:00100000:1.0:1789302578.770347:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505202432 00000100:00100000:1.0:1789302578.770411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789302578.770422:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:11689:x1876219505202432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302578.770715:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:11689:x1876219505202432:12345-0@lo:502:llog_process_th.0 Request processed in 294us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302578.770724:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789302578.771900:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11689:1876219505202432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302578.771969:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302578.771982:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302578.771985:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789302578.771991:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789302578.772566:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789302578.772592:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302578.772608:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302578.772623:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302578.772650:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789302578.772653:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6902e2c800 from 7 10000000:01000000:2.0:1789302578.772656:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302578.772703:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302578.772711:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302578.772720:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302578.772750:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302578.772831:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302578.772883:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6905944a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302578.773077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505202560 00000100:00100000:1.0:1789302578.773087:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505202560 00000100:00100000:1.0:1789302578.773151:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789302578.773162:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+17:5842:x1876219505202560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302578.773187:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302578.773204:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69421c9000/0x20be524657f11797 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f11790 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.773250:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69421c9000/0x20be524657f11797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f11790 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.773275:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69421c9000/0x20be524657f11797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f11790 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.773324:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9000, rc 0) 00000100:00100000:1.0:1789302578.773372:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505202560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302578.773378:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789302578.773604:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c51c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302578.773622:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302578.773633:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302578.773700:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302578.773732:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302578.773759:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b59e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302578.774045:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505202688 00000100:00100000:2.0:1789302578.774051:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505202688 00000100:00100000:2.0:1789302578.774094:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789302578.774103:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505202688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302578.776167:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505202688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2050us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302578.776192:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789302578.776347:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302578.776417:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302578.776481:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302578.776523:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789302578.776546:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505202816 00000100:00100000:1.0:1789302578.776552:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505202816 00000100:00100000:1.0:1789302578.776603:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789302578.776613:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505202816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302578.776825:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505202816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302578.776832:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789302578.776873:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505202816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302578.779139:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11691:1876219505202944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302578.779256:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302578.779345:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789302578.780480:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505202944 00000100:00100000:2.0:1789302578.780493:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505202944 00000100:00100000:2.0:1789302578.780562:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789302578.780575:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:11691:x1876219505202944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302578.780899:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+18:11691:x1876219505202944:12345-0@lo:502:llog_process_th.0 Request processed in 326us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302578.780922:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789302578.781123:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11691:1876219505202944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302578.781173:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302578.781196:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302578.781200:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789302578.781210:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6902e2c800 00000020:00000080:3.0:1789302578.781214:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789302578.781772:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11691:1876219505203072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302578.781837:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302578.781889:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505203072 00000100:00100000:3.0:1789302578.781897:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505203072 00000100:00100000:3.0:1789302578.781934:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789302578.781951:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:11691:x1876219505203072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302578.782151:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+18:11691:x1876219505203072:12345-0@lo:502:llog_process_th.0 Request processed in 203us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302578.782157:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789302578.782221:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7b9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302578.782236:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11691:1876219505203072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302578.782265:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302578.782271:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302578.782273:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789302578.782278:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789302578.782646:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789302578.782671:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302578.782693:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.782707:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302578.782719:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302578.782722:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6905909800 from 7 10000000:01000000:1.0:1789302578.782725:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302578.782759:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.782769:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.782780:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302578.782797:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505203200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302578.782836:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302578.782887:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302578.782995:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505203200 00000100:00100000:2.0:1789302578.783002:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505203200 00000100:00100000:2.0:1789302578.783046:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789302578.783055:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+18:5842:x1876219505203200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302578.783068:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302578.783084:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69033f9800/0x20be524657f117a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1179e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302578.783112:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f9800/0x20be524657f117a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1179e expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302578.783124:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69033f9800/0x20be524657f117a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1179e expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302578.783133:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9800, rc 0) 00000100:00100000:2.0:1789302578.783188:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505203200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302578.783194:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789302578.783750:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505203200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302578.783770:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.783782:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302578.783860:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505203328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302578.783908:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302578.783942:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302578.784049:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505203328 00000100:00100000:3.0:1789302578.784056:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505203328 00000100:00100000:3.0:1789302578.784097:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789302578.784105:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505203328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302578.785448:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505203328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1331us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302578.785463:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789302578.785723:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505203328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302578.785782:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505203456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302578.785836:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302578.785886:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302578.785948:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505203456 00000100:00100000:2.0:1789302578.785956:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505203456 00000100:00100000:2.0:1789302578.786009:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789302578.786019:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505203456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302578.786230:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:5842:x1876219505203456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302578.786238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789302578.786532:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8df8e325-951a-4604-89fa-82b64ca867d0:5842:1876219505203456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302578.786944:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11692:1876219505203584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302578.786995:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302578.787032:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302578.787127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505203584 00000100:00100000:2.0:1789302578.787151:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505203584 00000100:00100000:2.0:1789302578.787201:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789302578.787211:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:11692:x1876219505203584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302578.787451:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:11692:x1876219505203584:12345-0@lo:502:llog_process_th.0 Request processed in 242us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302578.787458:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789302578.787549:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903463b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11692:1876219505203584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302578.787586:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302578.787597:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302578.787600:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302578.787610:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6905909800 00000020:00000080:1.0:1789302578.787613:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789302578.787708:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11692:1876219505203712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302578.787737:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302578.787755:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505203712 00000100:00100000:1.0:1789302578.787758:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505203712 00000100:00100000:1.0:1789302578.787775:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789302578.787779:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:11692:x1876219505203712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302578.787910:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:11692:x1876219505203712:12345-0@lo:502:llog_process_th.0 Request processed in 129us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302578.787918:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789302578.787954:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302578.787967:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8df8e325-951a-4604-89fa-82b64ca867d0:11692:1876219505203712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302578.787987:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302578.787996:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302578.787998:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789302578.788002:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789302578.788066:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789302578.788090:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302578.788101:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302578.788114:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302578.814315:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789302579.086510:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505204096:0@lo:400:kworker.0 00000100:00100000:0.0:1789302579.086604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302579.086677:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505204608:0@lo:400:kworker.0 00000100:00100000:0.0:1789302579.086705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302579.086992:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505204096 00000100:00100000:1.0:1789302579.087003:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505204096 00000100:00100000:1.0:1789302579.087066:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789302579.087078:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505204096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302579.087145:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505204096:12345-0@lo:400:kworker.0 Request processed in 69us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302579.087152:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789302579.087384:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505203840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302579.087424:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302579.087462:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505204352:0@lo:400:kworker.0 00000100:00100000:3.0:1789302579.087645:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505204224:0@lo:400:kworker.0 00000100:00100000:3.0:1789302579.087682:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302579.087731:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505203968:0@lo:400:kworker.0 00000100:00100000:3.0:1789302579.087762:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302579.087784:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505204480:0@lo:400:kworker.0 00000100:00100000:3.0:1789302579.087831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302579.087864:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505204224 00000100:00100000:3.0:1789302579.087870:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505204224 00000100:00100000:3.0:1789302579.087925:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505204480 00000100:00100000:3.0:1789302579.087929:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505204480 00000100:00100000:1.0:1789302579.088047:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505203840 00000100:00100000:1.0:1789302579.088052:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505203840 00000100:00100000:1.0:1789302579.088089:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302579.088098:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876219505203840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302579.088142:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302579.088199:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876219505203840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302579.088207:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302579.088229:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505203968 00000100:00100000:1.0:1789302579.088232:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505203968 00000100:00100000:1.0:1789302579.088255:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789302579.088271:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505203968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302579.088334:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505203968:12345-0@lo:400:kworker.0 Request processed in 65us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302579.088707:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505204096:0@lo:400:kworker.0 00000100:00080000:0.0:1789302579.088770:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302579.088776:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302579.088790:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789302579.088801:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505204224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302579.088848:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505204224:12345-0@lo:400:kworker.0 Request processed in 49us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302579.088866:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789302579.088916:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505203968:0@lo:400:kworker.0 00000100:00100000:3.0:1789302579.089457:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789302579.089465:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505204480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302579.089568:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505204480:12345-0@lo:400:kworker.0 Request processed in 103us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302579.089574:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1789302579.089608:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302579.089736:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505204224:0@lo:400:kworker.0 00000100:00100000:1.0:1789302579.089827:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789302579.090441:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505204608 00000100:00100000:2.0:1789302579.090451:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505204608 00000100:00100000:2.0:1789302579.090500:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302579.090510:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876219505204608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302579.090577:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876219505204608:12345-0@lo:400:kworker.0 Request processed in 69us (3870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302579.090584:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302579.090611:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302579.090676:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505203840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302579.090701:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505204352 00000100:00100000:2.0:1789302579.090705:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505204352 00000100:00100000:2.0:1789302579.090733:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302579.090740:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505204352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302579.090780:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505204352:12345-0@lo:400:kworker.0 Request processed in 40us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302579.090786:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789302579.090818:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c72b100 x1876219505204352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302579.090844:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505204352:0@lo:400:kworker.0 00000100:00100000:0.0:1789302579.091301:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505204480:0@lo:400:kworker.0 00000100:00100000:1.0:1789302579.091672:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505204608:0@lo:400:kworker.0 00010000:00010000:0.0:1789302579.279404:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302579.854179:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789302580.301591:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302581.325519:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789302581.731835:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1789302582.125169:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302582.125224:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302582.125264:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302582.125340:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484199808 00000100:00100000:1.0:1789302582.125353:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484199808 00000100:00100000:2.0:1789302582.125373:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302582.125439:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484200064 00000100:00100000:1.0:1789302582.125443:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484200064 00000100:00080000:2.0:1789302582.125476:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302582.125477:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 109 00000100:00100000:1.0:1789302582.125489:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484199808:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302582.125496:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 110 00000100:00100000:2.0:1789302582.125504:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484200064:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302582.125588:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484199808:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302582.125596:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 109 00000100:00100000:3.0:1789302582.125750:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484199680 00000100:00100000:3.0:1789302582.125756:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484199680 00000100:00100000:0.0:1789302582.125920:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484199936 00000100:00100000:0.0:1789302582.125925:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484199936 00000100:00100000:0.0:1789302582.125971:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789302582.125980:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484199936:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302582.126032:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484200064:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 528us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302582.126039:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 110 00000100:00080000:2.0:1789302582.126072:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302582.126100:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 276 00000100:00100000:2.0:1789302582.126107:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6908d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484199680:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302582.126134:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6908d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484199680:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302582.126140:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 276 00000100:00100000:0.0:1789302582.134708:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484199936:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 8711us (9465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302582.134730:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00010000:00010000:3.0:1789302582.350642:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302583.374000:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302583.695916:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302583.695947:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505204736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302583.696052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302583.696361:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505204736 00000100:00100000:1.0:1789302583.696372:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505204736 00000100:00100000:1.0:1789302583.696463:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789302583.696474:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505204736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302583.696519:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302583.696582:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505204736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302583.696589:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789302583.696639:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c729180 x1876219505204736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302583.696662:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505204736:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302583.696928:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302584.205799:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505204992:0@lo:400:kworker.0 00000100:00100000:0.0:1789302584.205897:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302584.205980:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505205504:0@lo:400:kworker.0 00000100:00100000:0.0:1789302584.206010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302584.206053:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302584.206061:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505205120:0@lo:400:kworker.0 00000100:00100000:0.0:1789302584.206087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302584.206127:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505205504 00000100:00100000:0.0:1789302584.206146:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505205504 00000100:00100000:3.0:1789302584.206191:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505204992 00000100:00100000:3.0:1789302584.206196:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505204992 00000100:00100000:0.0:1789302584.206222:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789302584.206224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505205120 00000100:00100000:3.0:1789302584.206226:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505205120 00000100:00100000:0.0:1789302584.206232:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505205504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302584.206246:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789302584.206252:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505204992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302584.206320:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505204992:12345-0@lo:400:kworker.0 Request processed in 66us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302584.206328:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789302584.206347:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789302584.206354:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505205120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302584.206355:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505204864:0@lo:400:kworker.0 00000100:00100000:1.0:1789302584.207534:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302584.209628:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505204864 00000100:00100000:2.0:1789302584.209650:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505204864 00000100:00100000:2.0:1789302584.209748:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789302584.209761:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505204864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302584.209949:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505205120:12345-0@lo:400:kworker.0 Request processed in 3592us (3858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302584.209962:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789302584.210052:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505205632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302584.211038:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302584.211314:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505205248:0@lo:400:kworker.0 00000100:00100000:3.0:1789302584.211366:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302584.211429:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505205248 00000100:00100000:3.0:1789302584.211437:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505205248 00000100:00100000:3.0:1789302584.211486:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789302584.211495:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505205248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302584.211555:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505205248:12345-0@lo:400:kworker.0 Request processed in 61us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302584.211563:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789302584.211607:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c729180 x1876219505205248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302584.211623:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505205248:0@lo:400:kworker.0 00000100:00080000:3.0:1789302584.211663:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302584.211671:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302584.211701:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505205120:0@lo:400:kworker.0 00000100:00100000:3.0:1789302584.211715:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505204992:0@lo:400:kworker.0 00000100:00100000:3.0:1789302584.211750:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505205632 00000100:00100000:3.0:1789302584.211754:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505205632 00000100:00100000:3.0:1789302584.211783:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789302584.211790:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876219505205632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789302584.214364:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302584.214507:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876219505205632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2710us (3466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302584.214519:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789302584.214606:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789302584.214613:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6902ead180, transno 4294967300 00000100:00100000:3.0:1789302584.214642:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505205632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302584.215972:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505205376:0@lo:400:kworker.0 00000100:00100000:1.0:1789302584.216067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302584.216144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505205376 00000100:00100000:1.0:1789302584.216154:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505205376 00000100:00100000:1.0:1789302584.216228:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789302584.216239:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505205376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302584.216314:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505205376:12345-0@lo:400:kworker.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302584.216321:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1789302584.216344:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302584.216379:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505205376:0@lo:400:kworker.0 00000100:00100000:0.0:1789302584.228978:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505205504:12345-0@lo:400:kworker.0 Request processed in 22728us (22948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302584.229024:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789302584.229541:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505204864:12345-0@lo:400:kworker.0 Request processed in 19779us (23138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302584.229554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789302584.229699:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505204864:0@lo:400:kworker.0 00000100:00100000:3.0:1789302584.233267:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505205504:0@lo:400:kworker.0 00010000:00010000:3.0:1789302584.399414:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302585.421978:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302586.445586:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302587.246101:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302587.246163:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484200192 00000100:00100000:2.0:1789302587.246177:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484200192 00000100:00100000:2.0:1789302587.246244:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 278 00000100:00100000:2.0:1789302587.246256:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484200192:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302587.246384:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484200192:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 129us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302587.246392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 278 00000100:00100000:2.0:1789302587.254626:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302587.254692:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302587.255677:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302587.255862:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484200320 00000100:00100000:2.0:1789302587.255877:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484200320 00000100:00100000:2.0:1789302587.255965:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484200576 00000100:00100000:2.0:1789302587.255969:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484200576 00000100:00100000:2.0:1789302587.256001:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:2.0:1789302587.256015:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484200320:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:1.0:1789302587.256136:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302587.256283:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484200320:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 271us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302587.256314:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:2.0:1789302587.256334:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:2.0:1789302587.256341:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484200576:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302587.256489:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484200576:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 147us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302587.256497:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:2.0:1789302587.256522:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484200448 00000100:00100000:2.0:1789302587.256527:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484200448 00000100:00100000:2.0:1789302587.256574:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:2.0:1789302587.256583:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484200448:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302587.256611:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484200448:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 31us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302587.256619:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00080000:2.0:1789302587.256647:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789302587.470224:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302588.494082:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302588.813677:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302588.813702:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505205760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302588.813778:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302588.813983:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505205760 00000100:00100000:0.0:1789302588.813994:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505205760 00000100:00100000:0.0:1789302588.814065:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789302588.814076:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505205760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302588.814127:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302588.814184:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505205760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302588.814191:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789302588.814250:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789302588.814278:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c728e00 x1876219505205760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302588.814320:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505205760:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789302589.069952:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789302589.326500:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505205888:0@lo:400:kworker.0 00000100:00100000:2.0:1789302589.326578:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302589.326638:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505206400:0@lo:400:kworker.0 00000100:00100000:2.0:1789302589.326675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302589.326705:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789302589.326711:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505206272:0@lo:400:kworker.0 00000100:00100000:2.0:1789302589.326734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302589.326765:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505206400 00000100:00100000:2.0:1789302589.326773:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505206400 00000100:00100000:2.0:1789302589.326833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789302589.326842:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505206400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302589.326891:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505206400:12345-0@lo:400:kworker.0 Request processed in 50us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302589.326899:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1789302589.326939:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302589.326971:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505206400:0@lo:400:kworker.0 00000100:00100000:1.0:1789302589.327100:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505205888 00000100:00100000:1.0:1789302589.327112:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505205888 00000100:00100000:1.0:1789302589.327155:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789302589.327170:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505205888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302589.327208:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505205888:12345-0@lo:400:kworker.0 Request processed in 39us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302589.327214:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789302589.327349:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505206016:0@lo:400:kworker.0 00000100:00100000:0.0:1789302589.327380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302589.327411:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505206528:0@lo:400:kworker.0 00000100:00100000:0.0:1789302589.327433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302589.327452:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302589.327457:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505206144:0@lo:400:kworker.0 00000100:00100000:0.0:1789302589.327476:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302589.327501:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505206272 00000100:00100000:0.0:1789302589.327506:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505206272 00000100:00100000:0.0:1789302589.327532:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505206528 00000100:00100000:0.0:1789302589.327534:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505206528 00000100:00100000:0.0:1789302589.327556:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789302589.327563:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505206272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302589.327596:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505206272:12345-0@lo:400:kworker.0 Request processed in 34us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302589.327602:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789302589.327622:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789302589.327628:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505206528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302589.327676:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505206528:12345-0@lo:400:kworker.0 Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302589.327682:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789302589.327708:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505206528:0@lo:400:kworker.0 00000100:00100000:1.0:1789302589.327823:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505206016 00000100:00100000:1.0:1789302589.327827:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505206016 00000100:00100000:1.0:1789302589.327860:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505206144 00000100:00100000:1.0:1789302589.327863:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505206144 00000100:00100000:1.0:1789302589.327884:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789302589.327892:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505206016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302589.327931:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505206016:12345-0@lo:400:kworker.0 Request processed in 41us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302589.327937:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789302589.327947:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789302589.327953:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505206144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302589.327978:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505206144:12345-0@lo:400:kworker.0 Request processed in 26us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302589.327983:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789302589.328007:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505206144:0@lo:400:kworker.0 00000100:00100000:1.0:1789302589.328016:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505206016:0@lo:400:kworker.0 00000100:00100000:1.0:1789302589.329366:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302589.329383:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505206656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302589.329443:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302589.329491:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505206656 00000100:00100000:1.0:1789302589.329497:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505206656 00000100:00100000:1.0:1789302589.329542:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302589.329563:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505206656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302589.329600:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302589.329655:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505206656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302589.329661:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302589.329704:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505206656:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789302589.329870:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302589.329876:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789302589.329909:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a69362d0700 x1876219505206272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789302605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302589.329920:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505206272:0@lo:400:kworker.0 00000100:00100000:2.0:1789302589.329931:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505205888:0@lo:400:kworker.0 00010000:00010000:3.0:1789302589.518166:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302590.541880:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302591.567318:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302592.366602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302592.366646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302592.366785:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484200832 00000100:00100000:3.0:1789302592.366796:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484200832 00000100:00100000:3.0:1789302592.366871:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:3.0:1789302592.366882:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484200832:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302592.366949:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484200832:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302592.366957:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:2.0:1789302592.367096:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484200704 00000100:00100000:2.0:1789302592.367101:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484200704 00000100:00100000:2.0:1789302592.367145:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 280 00000100:00100000:2.0:1789302592.367153:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484200704:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302592.367183:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484200704:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 30us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302592.367189:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 280 00000100:00080000:0.0:1789302592.367812:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302592.378499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302592.378548:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302592.378666:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484200960 00000100:00100000:0.0:1789302592.378676:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484200960 00000100:00100000:0.0:1789302592.378759:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:0.0:1789302592.378771:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2350:x1876219484200960:12345-192.168.203.42@tcp:9:kworker.0 00000020:00000080:0.0:1789302592.378921:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f116e1 00000100:00080000:0.0:1789302592.378931:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a693bc92000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789302592.378980:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1789302592.379092:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789302592.379209:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302592.379339:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484201088 00000100:00100000:3.0:1789302592.379345:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484201088 00000100:00100000:3.0:1789302592.379397:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:3.0:1789302592.379405:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484201088:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302592.379491:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484201088:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 86us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302592.379498:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:0.0:1789302592.380061:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+2:2350:x1876219484200960:12345-192.168.203.42@tcp:9:kworker.0 Request processed in 1291us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302592.380071:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00080000:2.0:1789302592.381210:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302592.591306:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302593.614532:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302593.933758:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505206784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302593.933831:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302593.933963:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505206784 00000100:00100000:1.0:1789302593.933971:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505206784 00000100:00100000:1.0:1789302593.934038:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789302593.934059:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505206784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302593.934099:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302593.934149:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505206784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302593.934156:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789302593.934217:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c728e00 x1876219505206784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302593.934236:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505206784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789302593.934470:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302594.445624:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505207168:0@lo:400:kworker.0 00000100:00100000:3.0:1789302594.445696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302594.445757:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789302594.445764:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505207040:0@lo:400:kworker.0 00000100:00100000:3.0:1789302594.445792:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302594.445811:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505207552:0@lo:400:kworker.0 00000100:00100000:3.0:1789302594.445833:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302594.446058:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505207168 00000100:00100000:0.0:1789302594.446074:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505207168 00000100:00100000:0.0:1789302594.446126:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789302594.446135:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505207168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302594.446189:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505207168:12345-0@lo:400:kworker.0 Request processed in 55us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302594.446212:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789302594.446249:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505207296:0@lo:400:kworker.0 00000100:00100000:0.0:1789302594.446275:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302594.446311:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789302594.446317:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505206912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302594.446338:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302594.446353:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505207424:0@lo:400:kworker.0 00000100:00100000:0.0:1789302594.446371:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302594.446434:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505207296 00000100:00100000:3.0:1789302594.446439:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505207296 00000100:00100000:3.0:1789302594.446478:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505207424 00000100:00100000:3.0:1789302594.446481:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505207424 00000100:00100000:3.0:1789302594.446501:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789302594.446508:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505207296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302594.446542:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505207296:12345-0@lo:400:kworker.0 Request processed in 35us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302594.446549:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789302594.446561:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789302594.446566:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505207424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302594.446591:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505207424:12345-0@lo:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302594.446604:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789302594.446685:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505206912 00000100:00100000:1.0:1789302594.446700:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505206912 00000100:00100000:1.0:1789302594.446737:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789302594.446746:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505206912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302594.446772:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302594.446807:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505206912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302594.446823:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789302594.446868:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505207168:0@lo:400:kworker.0 00000100:00100000:2.0:1789302594.447040:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505207040 00000100:00100000:2.0:1789302594.447045:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505207040 00000100:00100000:2.0:1789302594.447086:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789302594.447093:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505207040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302594.447139:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505207040:12345-0@lo:400:kworker.0 Request processed in 46us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302594.447145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789302594.447181:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505207552 00000100:00100000:2.0:1789302594.447185:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505207552 00000100:00100000:2.0:1789302594.447209:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789302594.447215:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505207552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302594.447244:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505207552:12345-0@lo:400:kworker.0 Request processed in 30us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302594.447249:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302594.447903:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505207040:0@lo:400:kworker.0 00000100:00100000:1.0:1789302594.447918:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505207552:0@lo:400:kworker.0 00000100:00080000:0.0:1789302594.448622:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302594.448629:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302594.448669:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505206912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302594.448681:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505207424:0@lo:400:kworker.0 00000100:00100000:0.0:1789302594.448705:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505207296:0@lo:400:kworker.0 00010000:00010000:1.0:1789302594.638092:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302595.664608:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302596.687321:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789302597.068651:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:1.0:1789302597.068665:0:7652:0:(genops.c:885:class_export_put()) final put ffff9a693bc90000/ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:1.0:1789302597.068704:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a693bc90000/ace2f696-3715-4928-b36c-02db3411d1a3 for lustre-OST0001 00000020:00000080:1.0:1789302597.068766:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a693bc92000 for lustre-OST0001 00000100:00100000:3.0:1789302597.486518:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302597.488181:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302597.488225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302597.488269:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484201216 00000100:00100000:3.0:1789302597.488281:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484201216 00000100:00100000:3.0:1789302597.489498:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 282 00000100:00100000:3.0:1789302597.490608:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2354:x1876219484201216:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302597.490805:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2354:x1876219484201216:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 1290us (4300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302597.490817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 282 00000100:00100000:3.0:1789302597.490890:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484201472 00000100:00100000:3.0:1789302597.490900:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484201472 00000100:00100000:3.0:1789302597.490958:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484201344 00000100:00100000:3.0:1789302597.490962:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484201344 00000100:00100000:3.0:1789302597.490988:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00100000:3.0:1789302597.490996:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484201472:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302597.491032:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484201472:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 37us (2859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302597.491039:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00100000:3.0:1789302597.491061:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00100000:3.0:1789302597.491068:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484201344:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302597.492817:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484201344:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 1732us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302597.492844:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00080000:3.0:1789302597.492895:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789302597.709804:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302598.734232:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302599.057611:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505207680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302599.057848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302599.057994:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505207680 00000100:00100000:2.0:1789302599.058007:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505207680 00000100:00100000:2.0:1789302599.058100:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789302599.058113:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505207680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302599.058159:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789302599.068409:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302599.068866:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505207680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10747us (11009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302599.068885:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789302599.069779:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c729880 x1876219505207680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302599.069810:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505207680:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789302599.315918:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789302599.566904:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505207808:0@lo:400:kworker.0 00000100:00100000:3.0:1789302599.566938:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505207936:0@lo:400:kworker.0 00000100:00100000:3.0:1789302599.566974:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302599.566975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302599.567026:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505208320:0@lo:400:kworker.0 00000100:00100000:2.0:1789302599.567061:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302599.567097:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505208320 00000100:00100000:2.0:1789302599.567104:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505208320 00000100:00100000:2.0:1789302599.567163:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789302599.567173:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505208320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302599.567224:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505208320:12345-0@lo:400:kworker.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302599.567231:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789302599.567252:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302599.567302:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505208320:0@lo:400:kworker.0 00000100:00100000:0.0:1789302599.569818:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302599.569837:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505208448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302599.569897:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302599.569926:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505208448 00000100:00100000:2.0:1789302599.569934:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505208448 00000100:00100000:2.0:1789302599.569975:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789302599.569983:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505208448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302599.570016:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302599.570428:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505208448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 444us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302599.570446:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789302599.570730:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505208064:0@lo:400:kworker.0 00000100:00100000:3.0:1789302599.570766:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302599.570792:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302599.570799:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505208192:0@lo:400:kworker.0 00000100:00100000:3.0:1789302599.570820:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302599.570851:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505207936 00000100:00100000:3.0:1789302599.570855:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505207936 00000100:00100000:3.0:1789302599.570886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505208064 00000100:00100000:3.0:1789302599.570889:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505208064 00000100:00100000:3.0:1789302599.570916:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505208192 00000100:00100000:3.0:1789302599.570919:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505208192 00000100:00100000:3.0:1789302599.570934:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789302599.570940:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505207936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302599.570981:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505207936:12345-0@lo:400:kworker.0 Request processed in 41us (4007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302599.570995:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789302599.571009:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789302599.571015:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505208064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302599.571061:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505208064:12345-0@lo:400:kworker.0 Request processed in 46us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302599.571457:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505208448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302599.572226:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789302599.572261:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789302599.572270:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505208192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789302599.572380:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302599.572403:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505207808 00000100:00100000:2.0:1789302599.572409:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505207808 00000100:00100000:2.0:1789302599.572499:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789302599.572507:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505207808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302599.572563:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505207808:12345-0@lo:400:kworker.0 Request processed in 57us (5586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302599.572568:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789302599.573827:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505207808:0@lo:400:kworker.0 00000100:00100000:0.0:1789302599.573867:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505208064:0@lo:400:kworker.0 00000100:00100000:0.0:1789302599.573894:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505207936:0@lo:400:kworker.0 00000100:00100000:3.0:1789302599.574051:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505208192:12345-0@lo:400:kworker.0 Request processed in 1782us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302599.574059:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789302599.575015:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505208192:0@lo:400:kworker.0 00010000:00010000:0.0:1789302599.757820:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302600.782035:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302601.084592:0:11857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:29:58 (1789302598) 00010000:00010000:3.0:1789302601.806916:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302602.502490:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302602.502686:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484201600 00000100:00100000:1.0:1789302602.502700:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484201600 00000100:00100000:1.0:1789302602.502791:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:1.0:1789302602.502807:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:10250:x1876219484201600:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302602.502833:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302602.502863:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f117ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3660 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302602.502961:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f117b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302602.502978:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f117b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302602.502995:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f117b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789302602.503145:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789302602.503196:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789302602.503201:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302602.503253:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f117b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302602.503327:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f117ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3660 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302602.503356:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f117b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3660 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302602.503365:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302602.503369:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302602.503373:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c8c00, rc 0) 00000100:00100000:1.0:1789302602.503539:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:10250:x1876219484201600:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 736us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302602.503547:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:1.0:1789302602.510476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302602.510584:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484201728 00000100:00100000:2.0:1789302602.510598:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484201728 00000100:00100000:2.0:1789302602.510675:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:2.0:1789302602.510688:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:10251:x1876219484201728:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302602.510717:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302602.510743:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f117ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3667 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.510854:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.510873:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.510888:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.510905:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511048:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511057:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511579:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8a00/0x20be524657f117cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511588:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8a00/0x20be524657f117cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511596:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8a00/0x20be524657f117cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302602.511632:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789302602.511636:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302602.511660:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8a00/0x20be524657f117cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511683:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511691:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511699:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511706:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302602.511711:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511720:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511735:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302602.511738:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302602.511744:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511751:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f117c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511764:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511771:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511777:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511788:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302602.511791:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511798:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511806:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a6907c68700) 00010000:00010000:2.0:1789302602.511808:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302602.511811:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511818:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f117c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511855:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f117ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3667 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511870:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8a00/0x20be524657f117cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3667 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302602.511877:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:2.0:1789302602.511880:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302602.511882:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8a00, rc 0) 00000100:00100000:2.0:1789302602.513437:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:10251:x1876219484201728:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 2738us (2963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302602.513452:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:2.0:1789302602.516174:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302602.516335:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484201984 00000100:00100000:3.0:1789302602.516349:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484201984 00000100:00100000:3.0:1789302602.516424:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:3.0:1789302602.516436:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:10251:x1876219484201984:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302602.516461:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302602.516487:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f117d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b366e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.516581:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.516598:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.516620:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.516659:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.516668:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.516675:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517098:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f117eb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517108:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f117eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517116:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f117eb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302602.517128:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789302602.517832:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517844:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517852:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517858:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302602.517877:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517886:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517902:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:3.0:1789302602.517966:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302602.517974:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517981:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f117dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.517998:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.518004:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.518020:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.518026:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302602.518030:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.518037:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.518046:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a6904039d00) 00010000:00010000:3.0:1789302602.518230:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302602.518242:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.518248:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f117e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.519599:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f117d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b366e expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.519629:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f117eb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b366e expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302602.519639:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:3.0:1789302602.519642:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302602.519646:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6c00, rc 0) 00000100:00100000:3.0:1789302602.519820:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:10251:x1876219484201984:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 3385us (3661us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789302602.519831:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:2.0:1789302602.529079:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302602.529242:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484202112 00000100:00100000:1.0:1789302602.529255:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484202112 00000100:00100000:1.0:1789302602.529349:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:1.0:1789302602.529361:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+9:10251:x1876219484202112:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789302602.529501:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+9:10251:x1876219484202112:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 143us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302602.529509:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:1.0:1789302602.603404:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302602.603475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302602.603760:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484202240 00000100:00100000:3.0:1789302602.603774:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484202240 00000100:00100000:3.0:1789302602.603856:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 284 00000100:00100000:3.0:1789302602.603870:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484202240:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302602.603970:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484202240:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 103us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302602.603979:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 284 00000100:00100000:2.0:1789302602.604205:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484202368 00000100:00100000:2.0:1789302602.604211:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484202368 00000100:00100000:2.0:1789302602.604277:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:2.0:1789302602.604306:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484202368:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302602.604345:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484202368:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 61us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302602.604352:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00080000:3.0:1789302602.604908:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302602.829750:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302603.406622:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789302603.856243:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302604.184509:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505208576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302604.184599:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302604.184711:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505208576 00000100:00100000:3.0:1789302604.184723:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505208576 00000100:00100000:3.0:1789302604.184796:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789302604.184807:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505208576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789302604.184857:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302604.184925:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505208576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302604.184933:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789302604.184956:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302604.184988:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c385880 x1876219505208576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302604.185020:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505208576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302604.639050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302604.639238:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484202496 00000100:00100000:2.0:1789302604.639252:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484202496 00000100:00100000:2.0:1789302604.639373:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:2.0:1789302604.639386:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:10294:x1876219484202496:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302604.639414:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302604.639440:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f117f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3675 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639518:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639535:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639548:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639565:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639571:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639597:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639867:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639876:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639883:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639890:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302604.639895:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639904:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639918:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302604.639921:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302604.639927:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639934:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11800 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.639946:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789302604.640482:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789302604.642150:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.642183:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.642190:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302604.642497:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.642511:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.642531:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6907c68200) 00010000:00010000:2.0:1789302604.642534:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302604.642541:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.642548:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11807 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.642623:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f117f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3675 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.642637:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302604.642640:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302604.642645:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f117f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3675 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.642656:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8000, rc 0) 00000100:00100000:2.0:1789302604.642763:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:10294:x1876219484202496:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 3377us (3724us total) trans 0 rc 301/301 00000100:00100000:2.0:1789302604.642785:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:3.0:1789302604.650673:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302604.650720:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484202752 00000100:00100000:3.0:1789302604.650733:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484202752 00000100:00100000:3.0:1789302604.650804:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:3.0:1789302604.650817:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+9:10294:x1876219484202752:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:3.0:1789302604.650895:0:9859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302604.650930:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f117b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3660 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.652593:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a69051af900) 00010000:00010000:3.0:1789302604.652618:0:9859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302604.652944:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.655079:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.655097:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.655128:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.655136:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.655144:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302604.660788:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789302604.662492:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.662507:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.662517:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.662524:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302604.662530:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.662540:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.662584:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:3.0:1789302604.662588:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302604.662594:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.662601:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1180e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302604.662632:0:9859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d83cd2d reply state 000000006159ec18 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302604.662644:0:9859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302604.662813:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+10:10294:x1876219484202752:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 11991us (12148us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789302604.662823:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00010000:00010000:3.0:1789302604.665199:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.665224:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.665234:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.665242:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302604.665248:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.665257:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.665327:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6904039400) 00010000:00010000:3.0:1789302604.665331:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302604.665338:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302604.665345:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11815 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302604.687156:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302604.687192:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505208704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302604.687328:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302604.687884:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505209088:0@lo:400:kworker.0 00000100:00100000:1.0:1789302604.687927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302604.687950:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302604.687957:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505209216:0@lo:400:kworker.0 00000100:00100000:1.0:1789302604.687982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302604.688078:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505208832:0@lo:400:kworker.0 00000100:00100000:3.0:1789302604.688121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302604.688151:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302604.688157:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505208960:0@lo:400:kworker.0 00000100:00100000:3.0:1789302604.688183:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302604.688239:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505209088 00000100:00100000:3.0:1789302604.688249:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505209088 00000100:00100000:3.0:1789302604.688361:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505209216 00000100:00100000:3.0:1789302604.688365:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505209216 00000100:00100000:3.0:1789302604.688393:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505208960 00000100:00100000:3.0:1789302604.688396:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505208960 00000100:00100000:3.0:1789302604.688417:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789302604.688427:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505209088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302604.688492:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505209088:12345-0@lo:400:kworker.0 Request processed in 66us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302604.688500:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789302604.688521:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789302604.688527:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505209216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302604.688553:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505209216:12345-0@lo:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302604.688575:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789302604.688587:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789302604.688592:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505208960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302604.688624:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505208960:12345-0@lo:400:kworker.0 Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302604.688631:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1789302604.688649:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302604.688701:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505208960:0@lo:400:kworker.0 00000100:00100000:1.0:1789302604.689439:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505209216:0@lo:400:kworker.0 00000100:00100000:1.0:1789302604.689455:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505209088:0@lo:400:kworker.0 00000100:00100000:0.0:1789302604.690092:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505208704 00000100:00100000:0.0:1789302604.690103:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505208704 00000100:00100000:0.0:1789302604.690181:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789302604.690192:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505208704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302604.690241:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302604.690348:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505208704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302604.690355:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789302604.690410:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505208832 00000100:00100000:0.0:1789302604.690414:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505208832 00000100:00100000:0.0:1789302604.690443:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789302604.690450:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505208832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302604.690494:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505208832:12345-0@lo:400:kworker.0 Request processed in 44us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302604.690500:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789302604.690551:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505208832:0@lo:400:kworker.0 00000100:00100000:0.0:1789302604.690593:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c72a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505208704:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789302604.691468:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302604.775220:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302604.775343:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484202880 00000100:00100000:2.0:1789302604.775357:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484202880 00000100:00100000:2.0:1789302604.775431:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:2.0:1789302604.775444:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+9:10302:x1876219484202880:12345-192.168.203.42@tcp:101:lctl.0 00010000:00010000:2.0:1789302604.775477:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302604.775506:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f1181c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b367c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.775588:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11823 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.775605:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.775620:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302604.775662:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789302604.775665:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302604.775713:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.775742:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f1181c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b367c expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.775764:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b367c expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.775790:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302604.775793:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302604.775798:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8e00, rc 0) 00000100:00100000:2.0:1789302604.775873:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+10:10302:x1876219484202880:12345-192.168.203.42@tcp:101:lctl.0 Request processed in 431us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302604.775881:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:0.0:1789302604.843236:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302604.843394:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484203008 00000100:00100000:2.0:1789302604.843407:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484203008 00000100:00100000:2.0:1789302604.843486:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:2.0:1789302604.843498:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+10:10308:x1876219484203008:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302604.843524:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302604.843552:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f1182a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3683 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843631:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843648:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843663:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843680:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843688:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843715:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843942:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f1183f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843951:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f1183f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.843959:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f1183f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302604.843991:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789302604.844005:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302604.844050:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f1183f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844064:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844072:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844079:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844085:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302604.844090:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844099:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844119:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302604.844122:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302604.844129:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844136:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844149:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844156:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844162:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844167:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302604.844170:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844176:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844184:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6907c68e00) 00010000:00010000:2.0:1789302604.844186:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302604.844189:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844195:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11838 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844244:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f1182a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3683 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844259:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f1183f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3683 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302604.844267:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:2.0:1789302604.844269:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789302604.844272:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8000, rc 0) 00000100:00100000:2.0:1789302604.844489:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+11:10308:x1876219484203008:12345-192.168.203.42@tcp:101:bash.0 Request processed in 991us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302604.844497:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:2.0:1789302604.855915:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302604.856034:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484203264 00000100:00100000:0.0:1789302604.856047:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484203264 00000100:00100000:0.0:1789302604.856189:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:0.0:1789302604.856214:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+11:10308:x1876219484203264:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302604.856243:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302604.856337:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11846 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b368a expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.856517:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.856535:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.856549:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.856646:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.856655:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.856663:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789302604.858006:0:6295:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789302604.858264:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858280:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858678:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858732:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858757:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858765:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858772:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302604.858778:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858787:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858802:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:0.0:1789302604.858806:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302604.858813:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858819:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1184d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302604.858838:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dd3aa8e reply state 000000007b24d992 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302604.858849:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789302604.858900:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11846 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 14 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858920:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 13 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.858942:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7200) 00010000:00010000:0.0:1789302604.858944:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302604.858948:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045e00, rc 0) 00000100:00100000:0.0:1789302604.859128:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+14:10308:x1876219484203264:12345-192.168.203.42@tcp:101:bash.0 Request processed in 2916us (3227us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789302604.859138:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 40 00010000:00010000:0.0:1789302604.867450:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.867475:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.867485:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.867492:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302604.867508:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.867519:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.867539:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69061a7100) 00010000:00010000:0.0:1789302604.867543:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302604.867549:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.867557:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11854 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302604.876831:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302604.877073:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484203392 00000100:00100000:0.0:1789302604.877088:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484203392 00000100:00100000:0.0:1789302604.877151:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:0.0:1789302604.877162:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876219484203392:12345-192.168.203.42@tcp:8:bash.0 00010000:00080000:0.0:1789302604.877213:0:10693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:0.0:1789302604.877253:0:10693:0:(genops.c:1384:class_connect()) connect: client ace2f696-3715-4928-b36c-02db3411d1a3, cookie 0x20be524657f11869 00002000:00100000:0.0:1789302604.877266:0:10693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ace2f696-3715-4928-b36c-02db3411d1a3/ffff9a6906125000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789302604.877281:0:10693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00010000:3.0:1789302604.877607:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789302604.877640:0:10693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789302604.877683:0:10693:0:(import.c:65:import_set_state_nolock()) ffff9a6906127800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302604.877780:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2350:x1876219484203392:12345-192.168.203.42@tcp:8:bash.0 Request processed in 617us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302604.877790:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:2.0:1789302604.881887:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302604.882661:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484203520 00000100:00100000:1.0:1789302604.882676:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484203520 00000100:00100000:1.0:1789302604.882784:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789302604.882798:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:0:x1876219484203520:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302604.882820:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302604.882848:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3691 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302604.882884:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789302604.882907:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=316s v=(0 0) 00010000:00010000:1.0:1789302604.882912:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302604.882923:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302604.882973:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789302604.882984:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789302604.882991:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c8c00, rc 0) 00000100:00100000:1.0:1789302604.883087:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:0:x1876219484203520:12345-192.168.203.42@tcp:101:bash.0 Request processed in 291us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302604.883094:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:2.0:1789302604.890970:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302604.891119:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484203648 00000100:00100000:0.0:1789302604.891144:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484203648 00000100:00100000:0.0:1789302604.891217:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789302604.891237:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:10308:x1876219484203648:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302604.891263:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302604.891350:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3698 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.891393:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.891428:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302604.891436:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302604.891444:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302604.891578:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302604.891596:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 8 pid: 6696 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302604.891614:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1876219505209344:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302604.891739:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302604.896604:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1876219505209344:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302604.896605:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:1.0:1789302604.896663:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302604.896690:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045200, rc 0) 00000100:00100000:0.0:1789302604.896719:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484203776 00000100:00100000:0.0:1789302604.896729:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484203776 00000100:00100000:1.0:1789302604.896772:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:10308:x1876219484203648:12345-192.168.203.42@tcp:101:bash.0 Request processed in 5538us (5816us total) trans 0 rc 0/0 00010000:00010000:0.0:1789302604.896778:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 9 pid: 6696 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302604.896788:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789302604.896829:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:0.0:1789302604.896842:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484203776:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302604.896861:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302604.896897:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 8 pid: 6696 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.896913:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 8 pid: 6696 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.896945:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6753262/0x20be524657f11870 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3691 expref: 8 pid: 6696 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.896965:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302604.896970:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302604.896989:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.897012:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.897057:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302604.897075:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1876219505209472:192.168.203.42@tcp:105: 00000100:00100000:0.0:1789302604.897159:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690350c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789302604.910213:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302604.910584:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484204032 00000100:00100000:3.0:1789302604.910598:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484204032 00000100:00100000:3.0:1789302604.910678:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:3.0:1789302604.910691:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+13:10308:x1876219484204032:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:0.0:1789302604.910707:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1876219505209472:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789302604.910741:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302604.911161:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+14:10308:x1876219484204032:12345-192.168.203.42@tcp:35:bash.0 Request processed in 472us (962us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789302604.911170:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:0.0:1789302604.911208:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484203776:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 14367us (14613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302604.911227:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:2.0:1789302604.991043:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302604.991333:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484204288 00000100:00100000:0.0:1789302604.991348:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484204288 00000100:00100000:0.0:1789302604.991434:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789302604.991447:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+14:10318:x1876219484204288:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302604.991481:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302604.991508:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f1187e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b369f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302604.991626:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789302604.991803:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f1187e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b369f expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.991840:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:0.0:1789302604.991844:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302604.991851:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f1187e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b369f expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302604.991871:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045000, rc 0) 00000100:00100000:0.0:1789302604.991957:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+15:10318:x1876219484204288:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 512us (929us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789302604.991965:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:2.0:1789302604.996457:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302604.996551:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484204544 00000100:00100000:3.0:1789302604.996564:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484204544 00000100:00100000:3.0:1789302604.996638:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:3.0:1789302604.996650:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+15:10318:x1876219484204544:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789302604.996963:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+16:10318:x1876219484204544:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 314us (521us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789302604.996970:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:2.0:1789302605.066567:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.066684:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484204672 00000100:00100000:3.0:1789302605.066702:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484204672 00000100:00100000:3.0:1789302605.066795:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:3.0:1789302605.066809:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:10324:x1876219484204672:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302605.066846:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302605.066875:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f1188c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36a6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.067021:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.067039:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.067054:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302605.067096:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789302605.067100:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302605.067122:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.067154:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f1188c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36a6 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.067177:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36a6 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.067187:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302605.067190:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302605.067201:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6800, rc 0) 00000100:00100000:3.0:1789302605.067673:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+17:10324:x1876219484204672:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 864us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302605.067682:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:2.0:1789302605.075408:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302605.075520:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484204928 00000100:00100000:0.0:1789302605.075535:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484204928 00000100:00100000:0.0:1789302605.075611:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:0.0:1789302605.075623:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+17:10324:x1876219484204928:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302605.075651:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302605.075680:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1189a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36ad expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.075908:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f118a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.075928:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f118a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.075942:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f118a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302605.075956:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789302605.076278:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f1189a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36ad expref: 20 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.076342:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f118a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36ad expref: 19 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.076352:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7200) 00010000:00010000:0.0:1789302605.076356:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302605.076361:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045000, rc 0) 00000100:00100000:0.0:1789302605.077117:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+19:10324:x1876219484204928:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1488us (1717us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789302605.077130:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:0.0:1789302605.090643:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302605.090698:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.090945:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484205056 00000100:00100000:3.0:1789302605.090959:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484205056 00000100:00100000:3.0:1789302605.091062:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:3.0:1789302605.091075:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+19:2351:x1876219484205056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302605.091094:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302605.091131:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f118a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36ad expref: 19 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.091158:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7200) 00010000:00010000:3.0:1789302605.091165:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302605.091241:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:2351:x1876219484205056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 169us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302605.091249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:1.0:1789302605.091834:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484205312 00000100:00100000:1.0:1789302605.091843:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484205312 00000100:00100000:1.0:1789302605.091897:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:1.0:1789302605.091906:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+18:10324:x1876219484205312:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302605.091931:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302605.091949:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f118af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36b4 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.092090:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f118b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.092107:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f118b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.092121:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f118b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302605.092135:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789302605.092326:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f118af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36b4 expref: 21 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.092350:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f118b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36b4 expref: 20 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.092358:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7200) 00010000:00010000:1.0:1789302605.092361:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789302605.092364:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9600, rc 0) 00000100:00100000:1.0:1789302605.092415:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+20:10324:x1876219484205312:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 510us (1718us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789302605.092442:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:0.0:1789302605.104705:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302605.104835:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484205440 00000100:00100000:1.0:1789302605.104848:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484205440 00000100:00100000:1.0:1789302605.104968:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:1.0:1789302605.104981:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2354:x1876219484205440:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:1.0:1789302605.105072:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.105099:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.105108:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302605.105114:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302605.105119:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.105165:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.105488:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 7 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302605.105510:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1876219505209600:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302605.105686:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302605.112743:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302605.114140:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484205568 00000100:00100000:2.0:1789302605.114158:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484205568 00002000:00100000:2.0:1789302605.114233:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9a69362f3800 x1876219484205568/t0(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:181/0 lens 504/0 e 0 to 0 dl 1789302616 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302605.114270:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69362f3800 with x1876219484205568 ext(0->12) 00010000:00010000:2.0:1789302605.114327:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 8 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.114349:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 8 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302605.114358:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69362f3800 00000100:00100000:2.0:1789302605.114390:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:2.0:1789302605.114401:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484205568:12345-192.168.203.42@tcp:4:lfs.0 00000100:00100000:1.0:1789302605.119393:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1876219505209600:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302605.119455:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789302605.159849:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000100:00100000:3.0:1789302605.162844:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ace2f696-3715-4928-b36c-02db3411d1a3+9:2352:x1876219484205568:12345-192.168.203.42@tcp:4:lfs.0 Request processed in 48427us (50098us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789302605.162870:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00002000:00100000:3.0:1789302605.162898:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9a69362f3800 x1876219484205568/t4294967299(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:181/0 lens 504/448 e 0 to 0 dl 1789302616 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789302605.162909:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69362f3800 with x1876219484205568 ext(0->12) 00010000:00010000:3.0:1789302605.162923:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 9 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.162968:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 9 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302605.162976:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69362f3800 00000100:00100000:3.0:1789302605.166420:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302605.166526:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484205696 00000100:00100000:2.0:1789302605.166538:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484205696 00010000:00010000:2.0:1789302605.166586:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 9 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302605.166635:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:2.0:1789302605.166647:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484205696:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302605.166670:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789302605.166696:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789302605.166700:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789302603 00002000:00010000:2.0:1789302605.166703:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789302604 00002000:00010000:2.0:1789302605.166705:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789302603 00010000:00010000:2.0:1789302605.166712:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 9 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.166752:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 9 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.166784:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065d66c06/0x20be524657f11877 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3698 expref: 9 pid: 6697 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.166809:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302605.166814:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302605.166821:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.166831:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.166874:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302605.166959:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484205696:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 304us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302605.166969:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00010000:00010000:3.0:1789302605.168240:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.168263:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.168339:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.168349:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.168358:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.168366:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302605.168371:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.168380:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.168422:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.168430:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000669e5edc/0x20be524657f118c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302605.168540:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2354:x1876219484205440:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 63558us (63853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302605.168551:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:3.0:1789302605.172522:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302605.172640:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484205952 00000100:00100000:0.0:1789302605.172655:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484205952 00000100:00100000:0.0:1789302605.172717:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:0.0:1789302605.172729:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+20:10324:x1876219484205952:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:0.0:1789302605.172814:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f118b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36b4 expref: 20 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302605.173383:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789302605.173448:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789302605.175498:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789302605.175661:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.175707:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 24 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.175717:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.175767:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 24 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.175787:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 24 pid: 6295 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302605.175805:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876219505209728:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302605.176347:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690350ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302605.179821:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.179925:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484206080 00000100:00100000:3.0:1789302605.179937:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484206080 00010000:00010000:3.0:1789302605.180005:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 25 pid: 6295 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302605.180452:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:1.0:1789302605.180474:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+25:2352:x1876219484206080:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302605.180495:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302605.180504:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 25 pid: 6295 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.180519:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 25 pid: 6295 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.180545:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7200) 00010000:00010000:1.0:1789302605.180550:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.180561:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.180569:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.180594:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302605.180662:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+25:2352:x1876219484206080:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 197us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302605.180669:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00010000:00010000:0.0:1789302605.181916:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1185b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b368a expref: 24 pid: 6295 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302605.181956:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876219505209728:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302605.181988:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.182008:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.182015:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302605.182395:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789302605.182675:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789302605.182811:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505209856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789302605.182942:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302605.183002:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690be11000 going to sleep for 11 seconds 00000100:00100000:2.0:1789302605.183250:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505209856 00000100:00100000:2.0:1789302605.183260:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505209856 00000100:00100000:2.0:1789302605.183354:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302605.183365:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505209856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789302605.183466:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505209856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302605.183488:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302605.187444:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505209856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789302605.188875:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789302605.189586:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505209984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789302605.189687:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302605.189735:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789302605.189814:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505209984 00000100:00100000:2.0:1789302605.189824:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505209984 00000100:00100000:2.0:1789302605.190224:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302605.190239:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505209984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789302605.190562:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876219505209984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 326us (875us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789302605.190572:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302605.190670:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505209984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789302605.190750:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789302605.190802:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.190813:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.190822:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.190829:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302605.190834:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.190843:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.190862:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7200) 00010000:00010000:1.0:1789302605.190866:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789302605.190872:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.190879:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f118cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789302605.191566:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789302605.191848:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789302605.191862:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316377575787ns, next at 317377572896ns, rc = 0 00000001:00080000:1.0:1789302605.191895:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789302605.191958:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7200) 00010000:00010000:1.0:1789302605.191962:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789302605.191973:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f118b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36b4 expref: 28 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302605.192479:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+27:10324:x1876219484205952:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 19749us (19966us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789302605.192491:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000020:00080000:1.0:1789302605.192497:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789302605.195816:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.196235:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484206208 00000100:00100000:3.0:1789302605.196250:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484206208 00000100:00100000:2.0:1789302605.196652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:2.0:1789302605.196669:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+27:10324:x1876219484206208:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302605.196702:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302605.196733:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f118d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.196809:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f118d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36bb expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.196828:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f118d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36bb expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.196850:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:2.0:1789302605.196853:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302605.196858:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9c00, rc 0) 00000100:00100000:2.0:1789302605.197211:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+28:10324:x1876219484206208:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 547us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302605.197240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:2.0:1789302605.201170:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302605.201733:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484206464 00000100:00100000:1.0:1789302605.201747:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484206464 00000100:00100000:1.0:1789302605.201867:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:1.0:1789302605.201879:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690631f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+28:10324:x1876219484206464:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302605.202524:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690631f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+29:10324:x1876219484206464:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 645us (1366us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789302605.202534:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:3.0:1789302605.267335:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302605.267457:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484206720 00000100:00100000:0.0:1789302605.267471:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484206720 00000100:00100000:0.0:1789302605.267556:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:0.0:1789302605.267570:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+29:10334:x1876219484206720:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302605.267604:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302605.267633:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f118d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36c2 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302605.267756:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789302605.267927:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f118d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c2 expref: 31 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.267945:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:0.0:1789302605.267948:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302605.267954:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f118d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c2 expref: 31 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.267974:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045e00, rc 0) 00000100:00100000:0.0:1789302605.268066:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+30:10334:x1876219484206720:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 500us (799us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789302605.268074:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:2.0:1789302605.272429:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.272585:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484206848 00000100:00100000:3.0:1789302605.272600:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484206848 00000100:00100000:3.0:1789302605.272711:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:3.0:1789302605.272723:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+30:10334:x1876219484206848:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:3.0:1789302605.272841:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.272863:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.272902:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.272922:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.272929:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.272935:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273089:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273105:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273113:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302605.273167:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273182:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273190:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273198:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273215:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302605.273221:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273230:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273245:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302605.273248:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302605.273254:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273261:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f118e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273277:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273283:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273335:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273340:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302605.273343:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273349:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273367:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6904039400) 00010000:00010000:3.0:1789302605.273369:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302605.273372:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273378:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f118ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273394:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273400:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273406:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273412:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302605.273415:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273421:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273428:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:3.0:1789302605.273431:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302605.273434:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.273440:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f118f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302605.273553:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+30:10334:x1876219484206848:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 831us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302605.273562:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:2.0:1789302605.275848:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.276034:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484207104 00000100:00100000:3.0:1789302605.276056:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484207104 00000100:00100000:3.0:1789302605.276340:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:3.0:1789302605.276355:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+30:10334:x1876219484207104:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789302605.276666:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+31:10334:x1876219484207104:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 313us (831us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789302605.276675:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:2.0:1789302605.309437:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302605.309569:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484207360 00000100:00100000:0.0:1789302605.309583:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484207360 00000100:00100000:0.0:1789302605.309663:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:0.0:1789302605.309675:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+31:10337:x1876219484207360:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302605.309710:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302605.309737:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f118fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.309872:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.309890:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.309916:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.309936:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.309944:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.309950:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310115:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310126:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310147:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302605.310159:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789302605.310339:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310348:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310355:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310361:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302605.310367:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310375:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310388:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:0.0:1789302605.310391:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302605.310398:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310404:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11903 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310421:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310426:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310438:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310443:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302605.310446:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310452:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310460:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69061a7100) 00010000:00010000:0.0:1789302605.310463:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302605.310466:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310472:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1190a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310523:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f118fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310540:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.310548:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302605.310550:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302605.310553:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044e00, rc 0) 00000100:00100000:0.0:1789302605.310655:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+33:10337:x1876219484207360:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 982us (1235us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789302605.310674:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:2.0:1789302605.314024:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302605.314230:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484207488 00000100:00100000:1.0:1789302605.314243:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484207488 00000100:00100000:1.0:1789302605.314350:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:1.0:1789302605.314364:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+33:10337:x1876219484207488:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:1.0:1789302605.314463:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314484:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314498:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314549:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314557:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314565:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314572:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302605.314576:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314585:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314599:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:1.0:1789302605.314603:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302605.314608:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302605.314616:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f1191f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302605.314721:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+33:10337:x1876219484207488:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 360us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302605.314730:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789302605.317088:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302605.317254:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484207744 00000100:00100000:1.0:1789302605.317268:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484207744 00000100:00100000:1.0:1789302605.317381:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789302605.317413:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+33:10337:x1876219484207744:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302605.317710:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+34:10337:x1876219484207744:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 299us (635us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789302605.317718:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:2.0:1789302605.552173:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.552466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484208000 00000100:00100000:3.0:1789302605.552481:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484208000 00000100:00100000:3.0:1789302605.552613:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:3.0:1789302605.552626:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+34:10368:x1876219484208000:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1789302605.552661:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302605.552699:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11926 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36d0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.552827:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1192d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.552845:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1192d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.552858:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1192d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302605.552904:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789302605.553131:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d0 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.553158:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1192d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d0 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.553168:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:3.0:1789302605.553171:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302605.553175:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6a00, rc 0) 00000100:00100000:3.0:1789302605.553490:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+36:10368:x1876219484208000:12345-192.168.203.42@tcp:101:cat.0 Request processed in 862us (1329us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789302605.553499:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:2.0:1789302605.560607:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302605.560721:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484208256 00000100:00100000:1.0:1789302605.560735:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484208256 00000100:00100000:1.0:1789302605.560811:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789302605.560824:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+36:10368:x1876219484208256:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:1.0:1789302605.561566:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+37:10368:x1876219484208256:12345-192.168.203.42@tcp:35:cat.0 Request processed in 739us (968us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789302605.561577:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:2.0:1789302605.565835:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.566135:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484208384 00000100:00100000:3.0:1789302605.566151:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484208384 00000100:00100000:3.0:1789302605.566239:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:3.0:1789302605.566251:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+37:2352:x1876219484208384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302605.566273:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302605.566339:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1192d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d0 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.566364:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:3.0:1789302605.566371:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302605.566450:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+36:2352:x1876219484208384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 202us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302605.566458:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:2.0:1789302605.632210:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302605.633106:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484208640 00000100:00100000:0.0:1789302605.633124:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484208640 00000100:00100000:0.0:1789302605.633263:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:0.0:1789302605.633276:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+36:10374:x1876219484208640:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:0.0:1789302605.633341:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302605.633346:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789302605.633381:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36a6 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.633404:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:0.0:1789302605.633410:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302605.633428:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1193b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36d7 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.633550:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.633566:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.633577:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.633620:0:6295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.633637:0:6295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 36 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302605.633674:0:6295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6295:1876219505210112:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302605.634028:0:6295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302605.638721:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302605.638830:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484208768 00000100:00100000:2.0:1789302605.638844:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484208768 00010000:00010000:2.0:1789302605.638908:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 37 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302605.638952:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:2.0:1789302605.638964:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+37:2351:x1876219484208768:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302605.638982:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302605.639001:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 37 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.639018:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 37 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.639056:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:2.0:1789302605.639063:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.639099:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.639110:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.639140:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302605.639259:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+37:2351:x1876219484208768:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 297us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302605.639268:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00010000:00010000:0.0:1789302605.642393:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11911 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36c9 expref: 36 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302605.642428:0:6295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6295:1876219505210112:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302605.642463:0:6295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.642475:0:6295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.642481:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302605.642510:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789302605.642756:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f1193b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 37 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.642774:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 36 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.642784:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302605.642787:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789302605.642792:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044c00, rc 0) 00000100:00100000:0.0:1789302605.642882:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+36:10374:x1876219484208640:12345-192.168.203.42@tcp:101:dd.0 Request processed in 9609us (10688us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789302605.642913:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:1.0:1789302605.649499:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302605.649927:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484209024 00000100:00100000:0.0:1789302605.649941:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484209024 00000100:00100000:0.0:1789302605.650027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:0.0:1789302605.650040:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+36:10374:x1876219484209024:12345-192.168.203.42@tcp:36:dd.0 00010000:00010000:0.0:1789302605.650437:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.650461:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.650476:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302605.650534:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789302605.650564:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005868da51 reply state 000000001872eee0 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302605.650574:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302605.650703:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+39:10374:x1876219484209024:12345-192.168.203.42@tcp:36:dd.0 Request processed in 664us (1217us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789302605.650711:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000020:00080000:0.0:1789302605.650718:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789302605.654561:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.654588:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.654598:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.654606:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302605.654622:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.654632:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.654656:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:3.0:1789302605.654659:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302605.654667:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.654675:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11950 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302605.902067:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302605.960247:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.960415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484209152 00000100:00100000:3.0:1789302605.960429:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484209152 00000100:00100000:3.0:1789302605.960510:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:3.0:1789302605.960524:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+38:10388:x1876219484209152:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:3.0:1789302605.960559:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302605.960586:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11957 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36de expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960711:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960800:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960814:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960834:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960841:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960847:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960956:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960967:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 39 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.960976:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.961037:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 39 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.961065:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 39 pid: 6295 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302605.961082:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c385180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505210240:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302605.961264:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904219d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302605.969083:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c385180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505210240:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302605.969128:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302605.970271:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.970647:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484209408 00000100:00100000:3.0:1789302605.970658:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484209408 00000100:00100000:3.0:1789302605.971484:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:3.0:1789302605.971508:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+40:5590:x1876219484209408:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789302605.972318:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+41:5590:x1876219484209408:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 813us (2046us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789302605.972329:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789302605.975276:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302605.975399:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484209536 00000100:00100000:3.0:1789302605.975414:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484209536 00010000:00010000:3.0:1789302605.975468:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 41 pid: 6295 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302605.975567:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:3.0:1789302605.975578:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+41:2352:x1876219484209536:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302605.975597:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302605.975624:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 41 pid: 6295 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.975639:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 41 pid: 6295 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.975667:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11942 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36d7 expref: 41 pid: 6295 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.975689:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:3.0:1789302605.975696:0:6712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.975707:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.975715:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302605.975755:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302605.975829:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+40:2352:x1876219484209536:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 252us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302605.975837:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00010000:00010000:2.0:1789302605.976069:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976078:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302605.976144:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789302605.976149:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302605.976203:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976218:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976228:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976234:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976256:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976262:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302605.976267:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976277:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976313:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:2.0:1789302605.976317:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302605.976321:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976327:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1195e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976339:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976345:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976350:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976354:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302605.976357:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976373:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976381:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6904039400) 00010000:00010000:2.0:1789302605.976383:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302605.976387:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976392:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976436:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11957 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36de expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976452:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36de expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302605.976459:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:2.0:1789302605.976462:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302605.976464:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7200, rc 0) 00000100:00100000:2.0:1789302605.976514:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+39:10388:x1876219484209152:12345-192.168.203.42@tcp:101:stat.0 Request processed in 15993us (16283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302605.976523:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:2.0:1789302606.037815:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302606.037933:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484209792 00000100:00100000:0.0:1789302606.037957:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484209792 00000100:00100000:0.0:1789302606.038052:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:0.0:1789302606.038063:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+39:10394:x1876219484209792:12345-192.168.203.42@tcp:36:truncate.0 00010000:00010000:0.0:1789302606.038138:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302606.038192:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1196c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36de expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.038216:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302606.038223:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302606.038536:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.038553:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.038564:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302606.038613:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789302606.038637:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074f1dea7 reply state 00000000150cbf45 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302606.038647:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302606.038796:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+41:10394:x1876219484209792:12345-192.168.203.42@tcp:36:truncate.0 Request processed in 734us (995us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789302606.038804:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00000020:00080000:0.0:1789302606.038810:0:6295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1789302606.039129:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302606.040622:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.040642:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.040651:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.040677:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302606.040683:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.040691:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.040712:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302606.040715:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302606.040722:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.040729:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11973 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302606.266429:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302606.266542:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484209920 00000100:00100000:0.0:1789302606.266556:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484209920 00000100:00100000:0.0:1789302606.266636:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:0.0:1789302606.266648:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+40:10408:x1876219484209920:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:0.0:1789302606.266682:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302606.266710:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1197a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36e5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.266796:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.266816:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.266829:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.266863:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.266871:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.266879:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267139:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267149:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267158:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302606.267201:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789302606.267207:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302606.267236:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267251:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267260:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267267:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267336:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267344:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302606.267349:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267358:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267372:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:0.0:1789302606.267376:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302606.267382:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267388:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11981 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267403:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267409:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267414:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267418:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302606.267421:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267437:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267446:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69061a7100) 00010000:00010000:0.0:1789302606.267449:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302606.267452:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267457:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267498:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1197a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267515:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.267522:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302606.267524:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302606.267527:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044c00, rc 0) 00000100:00100000:0.0:1789302606.267618:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+41:10408:x1876219484209920:12345-192.168.203.42@tcp:101:stat.0 Request processed in 972us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302606.267627:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:1.0:1789302606.356089:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302606.356245:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484210176 00000100:00100000:2.0:1789302606.356260:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484210176 00000100:00100000:2.0:1789302606.356381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:2.0:1789302606.356416:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+41:10418:x1876219484210176:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302606.356447:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302606.356475:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36ec expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302606.356606:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789302606.356770:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11996 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36ec expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.356787:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302606.356790:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302606.356796:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36ec expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.356812:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8600, rc 0) 00000100:00100000:2.0:1789302606.356897:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+42:10418:x1876219484210176:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 485us (824us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789302606.356907:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:2.0:1789302606.360394:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.361261:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484210432 00000100:00100000:1.0:1789302606.361277:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484210432 00000100:00100000:1.0:1789302606.361420:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:1.0:1789302606.361433:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+42:10418:x1876219484210432:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302606.361777:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+43:10418:x1876219484210432:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 347us (1397us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789302606.361786:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789302606.448397:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302606.448624:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484210688 00000100:00100000:2.0:1789302606.448639:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484210688 00000100:00100000:2.0:1789302606.448727:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789302606.448740:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+43:10424:x1876219484210688:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302606.448772:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302606.448799:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f119a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.448964:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.448981:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.449002:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.449057:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.449074:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 44 pid: 5847 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302606.449090:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693bf8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505210368:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302606.449216:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6908daf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302606.454651:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693bf8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505210368:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302606.454692:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302606.454823:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.454939:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484210816 00000100:00100000:1.0:1789302606.454950:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484210816 00010000:00010000:1.0:1789302606.455180:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 45 pid: 5847 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302606.455228:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:1.0:1789302606.455242:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+45:2352:x1876219484210816:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302606.455262:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302606.455269:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 45 pid: 5847 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.455282:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 45 pid: 5847 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.455352:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1198f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36e5 expref: 45 pid: 5847 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.455373:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:1.0:1789302606.455378:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.455389:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.455399:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.455477:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302606.455559:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+44:2352:x1876219484210816:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 321us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302606.455567:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 40 00010000:00010000:0.0:1789302606.458223:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.458267:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302606.458365:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789302606.458990:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f119a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.459090:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.459150:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302606.459153:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789302606.459158:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8c00, rc 0) 00000100:00100000:0.0:1789302606.459333:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+44:10424:x1876219484210688:12345-192.168.203.42@tcp:101:bash.0 Request processed in 10593us (10949us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789302606.459344:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789302606.463009:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.463200:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484211072 00000100:00100000:1.0:1789302606.463214:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484211072 00000100:00100000:1.0:1789302606.463403:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:1.0:1789302606.463417:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+44:10424:x1876219484211072:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:1.0:1789302606.463897:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.463919:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.463933:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302606.463994:0:9859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1789302606.464022:0:9859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fc60250 reply state 00000000bd3e1c2b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302606.464040:0:9859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302606.464147:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+47:10424:x1876219484211072:12345-192.168.203.42@tcp:36:bash.0 Request processed in 733us (1151us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789302606.464155:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000020:00080000:1.0:1789302606.464162:0:9859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789302606.465980:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.466007:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.466016:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.466023:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302606.466035:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.466066:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.466085:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302606.466088:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302606.466094:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.466100:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302606.472156:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302606.472354:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484211200 00000100:00100000:0.0:1789302606.472369:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484211200 00000100:00100000:0.0:1789302606.472439:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:0.0:1789302606.472452:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+46:10424:x1876219484211200:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302606.472487:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302606.472524:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f119c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b36fa expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.472635:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.472653:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.472663:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.472722:0:6295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.472757:0:6295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 47 pid: 5846 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302606.472773:0:6295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6295:1876219505210496:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302606.472881:0:6295:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789302606.476932:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302606.477243:0:6295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6295:1876219505210496:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302606.477280:0:6295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302606.477415:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484211328 00000100:00100000:1.0:1789302606.477424:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484211328 00010000:00010000:1.0:1789302606.477480:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 48 pid: 5846 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302606.477530:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:1.0:1789302606.477543:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+48:2351:x1876219484211328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302606.477561:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302606.477586:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 48 pid: 5846 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.477600:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 48 pid: 5846 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.477629:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f119ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36f3 expref: 48 pid: 5846 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.477647:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:1.0:1789302606.477652:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.477663:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.477672:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.477713:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302606.477774:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c385c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+47:2351:x1876219484211328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 233us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302606.477781:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00010000:00010000:0.0:1789302606.477940:0:6295:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.477949:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302606.478015:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789302606.478021:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302606.478057:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.478108:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f119c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36fa expref: 47 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.478130:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36fa expref: 46 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.478138:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302606.478149:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302606.478153:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045600, rc 0) 00000100:00100000:0.0:1789302606.478184:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+46:10424:x1876219484211200:12345-192.168.203.42@tcp:101:bash.0 Request processed in 5735us (6044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302606.478191:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:2.0:1789302606.483243:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.483384:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484211584 00000100:00100000:1.0:1789302606.483398:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484211584 00000100:00100000:1.0:1789302606.483471:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:1.0:1789302606.483484:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690631c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+46:10424:x1876219484211584:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:1.0:1789302606.483852:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690631c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+47:10424:x1876219484211584:12345-192.168.203.42@tcp:35:bash.0 Request processed in 369us (623us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789302606.486112:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:2.0:1789302606.598458:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302606.598781:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484211840 00000100:00100000:0.0:1789302606.598794:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484211840 00000100:00100000:0.0:1789302606.598905:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789302606.598919:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+47:10434:x1876219484211840:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302606.598951:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302606.598997:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f119ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3701 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302606.599126:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789302606.599322:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f119ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3701 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.599339:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:0.0:1789302606.599343:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302606.599349:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f119ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3701 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.599367:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044e00, rc 0) 00000100:00100000:0.0:1789302606.599449:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+48:10434:x1876219484211840:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 533us (1007us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789302606.599456:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789302606.604129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.604230:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484211968 00000100:00100000:1.0:1789302606.604244:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484211968 00000100:00100000:1.0:1789302606.604477:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:1.0:1789302606.604501:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+48:10434:x1876219484211968:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:1.0:1789302606.604799:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.604821:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.604837:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.604856:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.604864:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.604872:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.604997:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605007:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605015:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302606.605077:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605341:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605350:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605357:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605363:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302606.605368:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605377:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605392:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:1.0:1789302606.605395:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302606.605402:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605408:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f119dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605431:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605438:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605453:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605458:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302606.605461:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605468:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605477:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69051af800) 00010000:00010000:1.0:1789302606.605480:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302606.605615:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605623:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f119e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605643:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605650:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605656:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605662:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302606.605665:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605683:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605692:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:1.0:1789302606.605694:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302606.605698:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.605770:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f119ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302606.605947:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+48:10434:x1876219484211968:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 1447us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302606.605957:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:3.0:1789302606.612458:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.612647:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484212224 00000100:00100000:1.0:1789302606.612662:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484212224 00000100:00100000:1.0:1789302606.612812:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:1.0:1789302606.612825:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+48:10434:x1876219484212224:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302606.613139:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+49:10434:x1876219484212224:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 315us (696us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789302606.613149:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:2.0:1789302606.656645:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302606.656829:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484212480 00000100:00100000:0.0:1789302606.656844:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484212480 00000100:00100000:0.0:1789302606.656956:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:0.0:1789302606.656974:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+49:10437:x1876219484212480:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302606.657032:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302606.657063:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f119f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3708 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.657177:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.657506:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.657523:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.657544:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.657565:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.657573:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658018:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658030:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658065:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302606.658081:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789302606.658420:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658430:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658437:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658444:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302606.658450:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658458:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658474:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:0.0:1789302606.658478:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302606.658483:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658490:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f119f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658507:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658514:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658528:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658533:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302606.658537:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658544:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658623:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69061a7100) 00010000:00010000:0.0:1789302606.658626:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302606.658630:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658636:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f119ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658703:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f119f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3708 expref: 52 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658791:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3708 expref: 51 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.658800:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302606.658802:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302606.658805:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045000, rc 0) 00000100:00100000:0.0:1789302606.658902:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+51:10437:x1876219484212480:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1935us (2271us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789302606.658923:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:3.0:1789302606.664079:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302606.664115:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.664603:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484212608 00000100:00100000:1.0:1789302606.664618:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484212608 00000100:00100000:0.0:1789302606.666101:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484212736 00000100:00100000:0.0:1789302606.666118:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484212736 00000100:00100000:1.0:1789302606.666925:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789302606.666950:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+52:2351:x1876219484212608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302606.666972:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302606.667023:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3708 expref: 52 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.667064:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:1.0:1789302606.667069:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302606.667647:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+51:2351:x1876219484212608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 705us (3579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302606.667657:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:0.0:1789302606.669823:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:0.0:1789302606.669857:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+50:10437:x1876219484212736:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:0.0:1789302606.669959:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.679820:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.679859:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.679908:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.679917:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.679925:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.679932:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302606.679937:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.679946:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.679962:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:0.0:1789302606.679999:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302606.680006:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.680012:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302606.680212:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+50:10437:x1876219484212736:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 10365us (16086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302606.680226:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:3.0:1789302606.686225:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.686377:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484212992 00000100:00100000:1.0:1789302606.686392:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484212992 00000100:00100000:1.0:1789302606.686467:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:1.0:1789302606.686480:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+50:10437:x1876219484212992:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302606.686792:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+51:10437:x1876219484212992:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 313us (582us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789302606.686800:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:3.0:1789302606.851931:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.852209:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484213248 00000100:00100000:1.0:1789302606.852223:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484213248 00000100:00100000:1.0:1789302606.852358:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:1.0:1789302606.852371:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+51:10455:x1876219484213248:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1789302606.852403:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302606.852430:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11a1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b370f expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.852555:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11a22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.852574:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11a22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.852612:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11a22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302606.852626:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789302606.852779:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11a1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b370f expref: 54 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.852806:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b370f expref: 53 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.852815:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:1.0:1789302606.852818:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789302606.852822:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9a00, rc 0) 00000100:00100000:1.0:1789302606.853014:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+53:10455:x1876219484213248:12345-192.168.203.42@tcp:101:cat.0 Request processed in 644us (1096us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789302606.853138:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:2.0:1789302606.903864:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302606.904004:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484213376 00000100:00100000:3.0:1789302606.904017:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484213376 00000100:00100000:3.0:1789302606.904099:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:3.0:1789302606.904112:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+53:10456:x1876219484213376:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302606.904147:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302606.904174:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3716 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302606.904257:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302606.904275:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302606.904748:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302606.904797:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789302606.904802:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302606.904825:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302606.904860:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3716 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302606.904884:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3716 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302606.904895:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302606.904918:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302606.904923:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7a00, rc 0) 00000100:00100000:3.0:1789302606.905067:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+54:10456:x1876219484213376:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 957us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302606.905076:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:3.0:1789302606.913694:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.918297:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484213760 00000100:00100000:1.0:1789302606.918320:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484213760 00000100:00100000:1.0:1789302606.918433:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:1.0:1789302606.918447:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+54:10456:x1876219484213760:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302606.920176:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+55:10456:x1876219484213760:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 1721us (6490us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789302606.920190:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:2.0:1789302606.923417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302606.923572:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484213888 00000100:00100000:1.0:1789302606.923586:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484213888 00000100:00100000:1.0:1789302606.923669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:1.0:1789302606.923683:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+55:10456:x1876219484213888:12345-192.168.203.42@tcp:103:lfs.0 00010000:00010000:1.0:1789302606.923720:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789302606.923754:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f119c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36fa expref: 55 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.923783:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11a22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b370f expref: 54 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.923803:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f118d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b36bb expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.923816:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:1.0:1789302606.923831:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302606.923962:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+52:10456:x1876219484213888:12345-192.168.203.42@tcp:103:lfs.0 Request processed in 281us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302606.923971:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:2.0:1789302606.926505:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302606.926592:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484214016 00000100:00100000:0.0:1789302606.926603:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484214016 00000100:00100000:0.0:1789302606.926674:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:0.0:1789302606.926687:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+52:10456:x1876219484214016:12345-192.168.203.42@tcp:58:lfs.0 00010000:00010000:0.0:1789302606.926846:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.926867:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302606.926945:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302606.927480:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302606.927699:0:6295:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302606.929578:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789302606.929680:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789302606.929841:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+52:10456:x1876219484214016:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 3149us (3341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302606.929856:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:3.0:1789302606.959733:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302606.959860:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484214144 00000100:00100000:2.0:1789302606.959901:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484214144 00000100:00100000:2.0:1789302606.959976:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:2.0:1789302606.959998:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+52:10458:x1876219484214144:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302606.960032:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302606.960057:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11a45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b371d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960140:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960158:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960171:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960187:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960194:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960201:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960641:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960653:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960661:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302606.960715:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789302606.960720:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302606.960742:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960757:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960767:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960774:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960781:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960787:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302606.960793:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960802:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960817:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:2.0:1789302606.960820:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302606.960826:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960832:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11a4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960860:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960867:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960884:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960892:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302606.960895:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960902:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960911:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6907c68400) 00010000:00010000:2.0:1789302606.960914:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302606.960917:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960923:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11a53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960962:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11a45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.960977:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302606.961011:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:2.0:1789302606.961014:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302606.961016:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8600, rc 0) 00000100:00100000:2.0:1789302606.961250:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+53:10458:x1876219484214144:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1253us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302606.961259:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 67 00000001:00080000:3.0:1789302607.321990:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000020:00080000:3.0:1789302607.322055:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a693ff1ccc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789302607.322061:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a690908a400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a693ff1c0c0 00000020:00080000:3.0:1789302607.322065:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a690908aa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6936c68000 00000020:00080000:1.0:1789302607.322194:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789302607.322391:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000001:00080000:3.0:1789302607.322867:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:3.0:1789302607.322951:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789302607.323497:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505210624:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789302607.323597:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302607.323778:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505210624 00000100:00100000:1.0:1789302607.323788:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505210624 00000100:00100000:1.0:1789302607.323866:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302607.323938:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1876219505210624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789302607.323972:0:10693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789302607.324034:0:10693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa6974b, atime: 0x6aa6974c, ctime: 0x6aa6974b, blocks: 0x1 00010000:00010000:1.0:1789302607.324045:0:10693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.324079:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1789302607.324084:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302607.324093:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.324112:0:10693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.324122:0:10693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.324244:0:10693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.324267:0:10693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789302607.324797:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302607.325257:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505210624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1378us (1656us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789302607.325268:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789302607.325446:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302607.325456:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.325469:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302607.325475:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.325488:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.325510:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.325533:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009f58736/0x20be524657f11a61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.325556:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302607.325558:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302607.325559:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789302607.325673:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69362d2680/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789302607.325681:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505210624:0@lo:6:osp-syn-0-0.0 00000040:00080000:3.0:1789302607.502530:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302607.502542:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302607.502606:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789302607.502615:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302607.503040:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505210752:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789302607.505666:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693671cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302607.513188:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302607.513236:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484214272 00000100:00100000:3.0:1789302607.513248:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484214272 00000100:00100000:3.0:1789302607.513368:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:3.0:1789302607.513379:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484214272:12345-192.168.203.42@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789302607.513478:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484214272:12345-192.168.203.42@tcp:900:lhsmtool_posix.0 Request processed in 99us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302607.513486:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:2.0:1789302607.513795:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505210752:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789302607.530223:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302607.530389:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484214400 00000100:00100000:3.0:1789302607.530402:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484214400 00000100:00100000:3.0:1789302607.530477:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:3.0:1789302607.530489:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+11:10469:x1876219484214400:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789302607.530536:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789302607.530702:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+11:10469:x1876219484214400:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 215us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302607.530710:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:1.0:1789302607.536506:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302607.536612:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484214528 00000100:00100000:0.0:1789302607.536625:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484214528 00000100:00100000:0.0:1789302607.536698:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:0.0:1789302607.536711:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+11:10469:x1876219484214528:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789302607.536808:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.536831:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.536847:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.536863:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.536870:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537062:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537099:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537108:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537136:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302607.537186:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789302607.537191:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302607.537212:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537226:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537233:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537241:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537247:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.537252:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537260:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537274:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:0.0:1789302607.537277:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302607.537312:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537319:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11a68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537351:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537358:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537364:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537369:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.537372:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537378:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537387:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9a69061a7b00) 00010000:00010000:0.0:1789302607.537389:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302607.537392:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537399:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11a6f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537417:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537423:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537429:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537441:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.537444:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537451:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537459:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:0.0:1789302607.537462:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302607.537465:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.537470:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.537768:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+11:10469:x1876219484214528:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 1056us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302607.537779:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789302607.550333:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302607.550439:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484214784 00000100:00100000:0.0:1789302607.550453:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484214784 00000100:00100000:0.0:1789302607.550523:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:0.0:1789302607.550534:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+11:10469:x1876219484214784:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302607.550573:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302607.550599:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11a7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3724 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.550725:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.550745:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.550759:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302607.550791:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789302607.551222:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551232:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551239:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551246:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.551251:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551259:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551273:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:0.0:1789302607.551277:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302607.551309:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551317:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551369:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11a7d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3724 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551379:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:0.0:1789302607.551382:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302607.551394:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11a7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3724 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.551404:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045e00, rc 0) 00000100:00100000:0.0:1789302607.551559:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484214784:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1026us (1241us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1789302607.551569:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:1.0:1789302607.566183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302607.566350:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484214912 00000100:00100000:0.0:1789302607.566362:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484214912 00000100:00100000:0.0:1789302607.566511:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:0.0:1789302607.566523:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484214912:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789302607.566570:0:9859:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789302607.566702:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484214912:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 181us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302607.566712:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:3.0:1789302607.575629:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302607.575683:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484215168 00000100:00100000:3.0:1789302607.575696:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484215168 00000100:00100000:3.0:1789302607.575769:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:3.0:1789302607.575781:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484215168:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302607.575808:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302607.575812:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302607.575846:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3716 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.575867:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302607.575873:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302607.575889:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11a92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b372b expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789302607.576758:0:6295:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789302607.577831:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11a99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.577854:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.577868:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.577961:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11a92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b372b expref: 14 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.577992:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b372b expref: 13 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.578001:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6904039200) 00010000:00010000:3.0:1789302607.578004:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302607.578008:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6200, rc 0) 00000100:00100000:3.0:1789302607.578100:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+13:10469:x1876219484215168:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 2321us (2482us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789302607.578110:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:3.0:1789302607.583113:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302607.583247:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484215424 00000100:00100000:0.0:1789302607.583261:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484215424 00000100:00100000:0.0:1789302607.583358:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:0.0:1789302607.583372:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+13:10469:x1876219484215424:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789302607.583451:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302607.583486:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11a99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b372b expref: 13 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.583513:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6904039200) 00010000:00010000:0.0:1789302607.583528:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302607.583561:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.583590:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.583603:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.583667:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.583676:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.583683:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584086:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584096:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584104:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584111:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.584116:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584124:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584136:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:0.0:1789302607.584145:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302607.584151:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584157:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11aa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584169:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584175:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584181:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584186:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.584189:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584196:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584204:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9752cd6f (ffff9a69061a7b00) 00010000:00010000:0.0:1789302607.584207:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302607.584210:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.584216:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11aae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9752cd6f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302607.584351:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484215424:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 981us (1251us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302607.584365:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:1.0:1789302607.586215:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302607.586393:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484215552 00000100:00100000:2.0:1789302607.586405:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484215552 00000100:00100000:2.0:1789302607.586463:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00100000:2.0:1789302607.586476:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484215552:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302607.586502:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302607.586528:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11ab5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3732 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.586570:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.586586:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.586599:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.586717:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 14 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.586754:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 13 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.586763:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:2.0:1789302607.586767:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789302607.586771:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8400, rc 0) 00000100:00100000:2.0:1789302607.586846:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+13:10469:x1876219484215552:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 373us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302607.586854:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00100000:3.0:1789302607.593139:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.593502:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484215808 00000100:00100000:1.0:1789302607.593532:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484215808 00000100:00100000:1.0:1789302607.593640:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:1.0:1789302607.593653:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+13:10469:x1876219484215808:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302607.593788:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.593811:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.593827:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302607.594514:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789302607.594528:0:6295:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318780241391ns, next at 319780238733ns, rc = 0 00000004:00010000:1.0:1789302607.594644:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ff4dffc reply state 000000006c8d0b4c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.594656:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302607.594782:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+15:10469:x1876219484215808:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 1129us (1658us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789302607.594791:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:3.0:1789302607.602691:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302607.602735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484215936 00000100:00100000:3.0:1789302607.602748:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484215936 00000100:00100000:3.0:1789302607.602814:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:3.0:1789302607.602827:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+15:10469:x1876219484215936:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302607.602859:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302607.603380:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3739 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.603470:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.603509:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.603536:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:3.0:1789302607.603540:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302607.603545:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302607.603624:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:10469:x1876219484215936:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 799us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302607.603632:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 76 00010000:00010000:0.0:1789302607.604694:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.604711:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.604720:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.604726:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.604732:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.604741:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.604758:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:0.0:1789302607.604761:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789302607.604766:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.604771:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11ac3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.612603:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302607.612811:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484216064 00000100:00100000:2.0:1789302607.612825:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484216064 00000100:00100000:2.0:1789302607.612898:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:2.0:1789302607.612907:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876219484216064:12345-192.168.203.42@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789302607.612947:0:6699:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1789302607.612994:0:6699:0:(genops.c:1384:class_connect()) connect: client ace2f696-3715-4928-b36c-02db3411d1a3, cookie 0x20be524657f11ad1 00002000:00100000:2.0:1789302607.613008:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ace2f696-3715-4928-b36c-02db3411d1a3/ffff9a6906135800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789302607.613155:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789302607.613485:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789302607.613527:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a6906134800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302607.613615:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2350:x1876219484216064:12345-192.168.203.42@tcp:8:lhsmtool_posix.0 Request processed in 706us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302607.613624:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:3.0:1789302607.618823:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.620414:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484216192 00000100:00100000:1.0:1789302607.620434:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484216192 00000100:00100000:1.0:1789302607.620571:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:1.0:1789302607.620585:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:0:x1876219484216192:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789302607.624074:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302607.684076:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:0:x1876219484216192:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 63478us (65254us total) trans 4294967301 rc 0/0 00000001:00080000:0.0:1789302607.684076:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1789302607.684092:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000001:00100000:0.0:1789302607.684096:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000100:00100000:0.0:1789302607.694309:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302607.694353:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484216448 00000100:00100000:3.0:1789302607.694366:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484216448 00000100:00100000:3.0:1789302607.694445:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:3.0:1789302607.694460:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+15:10469:x1876219484216448:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789302607.694789:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+16:10469:x1876219484216448:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 332us (510us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789302607.694797:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:2.0:1789302607.698753:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.698859:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484216704 00000100:00100000:1.0:1789302607.698881:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484216704 00000100:00100000:1.0:1789302607.698961:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:1.0:1789302607.698996:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+16:10469:x1876219484216704:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789302607.699160:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+16:10469:x1876219484216704:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 166us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302607.699167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:2.0:1789302607.704485:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302607.704626:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484216832 00000100:00100000:3.0:1789302607.704640:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484216832 00000100:00100000:3.0:1789302607.704720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:3.0:1789302607.704733:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:10469:x1876219484216832:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302607.704772:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302607.704810:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11ad8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3740 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.705485:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.705508:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302607.705525:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302607.705679:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302607.705720:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.705760:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11ad8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3740 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.705784:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3740 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.705793:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:0.0:1789302607.705797:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789302607.705801:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6a00, rc 0) 00000100:00100000:0.0:1789302607.705886:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+17:10469:x1876219484216832:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1155us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302607.705893:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:3.0:1789302607.718883:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302607.719020:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484216960 00000100:00100000:2.0:1789302607.719034:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484216960 00000100:00100000:2.0:1789302607.719111:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:2.0:1789302607.719124:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484216960:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302607.719155:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302607.719381:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3747 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302607.719419:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6974e, blocks: 0x1 00010000:00010000:2.0:1789302607.719447:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:2.0:1789302607.719453:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302607.719465:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.719491:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.719506:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9400, rc 0) 00000100:00100000:2.0:1789302607.719995:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484216960:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 871us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302607.720005:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:1.0:1789302607.728694:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.728749:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.728797:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.728829:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.728870:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484217344 00000100:00100000:1.0:1789302607.728894:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484217344 00000100:00100000:3.0:1789302607.728917:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484217216 00000100:00100000:3.0:1789302607.728924:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484217216 00000100:00100000:3.0:1789302607.728991:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:1.0:1789302607.728992:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484217600 00000100:00100000:1.0:1789302607.728998:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484217600 00000100:00100000:3.0:1789302607.729006:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484217216:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302607.729030:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 133 00000100:00100000:1.0:1789302607.729039:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484217344:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302607.729071:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:0.0:1789302607.729084:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+17:10469:x1876219484217600:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789302607.729115:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484217088 00000100:00100000:2.0:1789302607.729120:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484217088 00000100:00100000:2.0:1789302607.729313:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 286 00000100:00100000:2.0:1789302607.729325:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484217088:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302607.729472:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484217344:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 434us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302607.729481:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 133 00000100:00080000:1.0:1789302607.729683:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302607.729688:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302607.732504:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484217216:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 3482us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302607.732525:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:0.0:1789302607.732656:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+17:10469:x1876219484217600:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 3570us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302607.732668:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:2.0:1789302607.734233:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484217088:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 4896us (5537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302607.734263:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 286 00000100:00100000:3.0:1789302607.741153:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.741786:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484217728 00000100:00100000:1.0:1789302607.741801:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484217728 00000100:00100000:1.0:1789302607.742134:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:1.0:1789302607.742149:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:10469:x1876219484217728:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302607.742178:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302607.742215:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b374e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.742281:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.742313:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302607.742318:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302607.742325:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.742371:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.742387:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 7 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.742404:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1876219505210880:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302607.744531:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789302607.750775:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.750821:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484217856 00000100:00100000:1.0:1789302607.750833:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484217856 00000100:00100000:2.0:1789302607.750891:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1876219505210880:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302607.750899:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 8 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.750931:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.750943:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00010000:00010000:2.0:1789302607.750951:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9a00, rc 0) 00000100:00100000:1.0:1789302607.750953:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484217856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302607.751001:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789302607.751030:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:10469:x1876219484217728:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 8887us (9894us total) trans 0 rc 0/0 00010000:00010000:1.0:1789302607.751030:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 8 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302607.751039:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00010000:00010000:1.0:1789302607.751045:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 8 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.751074:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097e955a5/0x20be524657f11ae6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3747 expref: 7 pid: 6699 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.751087:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302607.751092:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302607.751101:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.751113:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.751153:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.751170:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902ead180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876219505211008:192.168.203.42@tcp:105: 00000100:00100000:1.0:1789302607.751246:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789302607.759140:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.759188:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484217984 00000100:00100000:1.0:1789302607.759209:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484217984 00002000:00100000:1.0:1789302607.759268:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a6902eac000 x1876219484217984/t0(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:183/0 lens 504/0 e 0 to 0 dl 1789302618 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302607.759281:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6902eac000 with x1876219484217984 ext(0->8) 00002000:00010000:1.0:1789302607.759305:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6902eac000 00000100:00100000:1.0:1789302607.759337:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:1.0:1789302607.759347:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484217984:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789302607.760586:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ace2f696-3715-4928-b36c-02db3411d1a3+9:2352:x1876219484217984:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 Request processed in 1230us (1448us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789302607.760599:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00002000:00100000:1.0:1789302607.760611:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a6902eac000 x1876219484217984/t4294967302(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:183/0 lens 504/448 e 0 to 0 dl 1789302618 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302607.760621:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6902eac000 with x1876219484217984 ext(0->8) 00002000:00010000:1.0:1789302607.760628:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6902eac000 00000100:00100000:3.0:1789302607.762828:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902ead180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876219505211008:192.168.203.42@tcp:105: 00010000:00010000:3.0:1789302607.762866:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302607.762950:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484217856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 11997us (12197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302607.762963:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:3.0:1789302607.765938:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302607.766035:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484218112 00000100:00100000:0.0:1789302607.766048:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484218112 00000100:00100000:0.0:1789302607.766116:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:0.0:1789302607.766129:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+17:10469:x1876219484218112:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789302607.865839:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:3.0:1789302607.865876:0:11976:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1789302607.865882:0:11976:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789302607.865895:0:11976:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1789302607.866113:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1789302607.866423:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789302607.866441:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789302607.869461:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505211136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789302607.869517:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:10469:x1876219484218112:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 103386us (103585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302607.869527:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:0.0:1789302607.869551:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302607.869834:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505211136 00000100:00100000:0.0:1789302607.869845:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505211136 00000100:00100000:0.0:1789302607.869947:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789302607.869957:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505211136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789302607.870352:0:10693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789302607.870357:0:10693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789302606 00002000:00010000:0.0:1789302607.870360:0:10693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789302607.870362:0:10693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789302606 -> 1789302606 00002000:00010000:0.0:1789302607.870365:0:10693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789302607.870416:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876219505211136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 459us (865us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789302607.870424:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1789302607.870477:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6936345500/2, rc 0, transno 4294967303 00000100:00100000:0.0:1789302607.870484:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505211136:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1789302607.870628:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302607.874616:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302607.883184:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484218240 00000100:00100000:0.0:1789302607.883205:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484218240 00000100:00100000:0.0:1789302607.883305:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789302607.883318:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484218240:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789302607.952053:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789302607.969804:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789302607.969831:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789302607.970146:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484218240:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 86822us (95534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302607.970161:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:2.0:1789302607.972565:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.973245:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484218496 00000100:00100000:1.0:1789302607.973257:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484218496 00000100:00100000:1.0:1789302607.973346:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:1.0:1789302607.973357:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+13:10469:x1876219484218496:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302607.973411:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302607.973438:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3740 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.973467:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:1.0:1789302607.973473:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302607.973505:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.973519:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.973528:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302607.973790:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6a5b0c0 reply state 000000002fd42ff4 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.973799:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302607.973896:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+14:10469:x1876219484218496:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 540us (1340us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789302607.973903:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 81 00010000:00010000:0.0:1789302607.975510:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.975532:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.975542:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.975561:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.975567:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.975577:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.975595:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:0.0:1789302607.975598:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302607.975604:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.975610:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11af4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302607.977412:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302607.977517:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484218624 00000100:00100000:0.0:1789302607.977532:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484218624 00000100:00100000:0.0:1789302607.977601:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:0.0:1789302607.977613:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484218624:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789302607.977946:0:10693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789302607.977951:0:10693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789302606 -> 1789302605 00002000:00010000:0.0:1789302607.977954:0:10693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789302604 00002000:00010000:0.0:1789302607.977956:0:10693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789302606 -> 1789302605 00002000:00010000:0.0:1789302607.977959:0:10693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789302607.978052:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484218624:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 440us (655us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789302607.978061:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:0.0:1789302607.983944:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302607.984057:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484218880 00000100:00100000:2.0:1789302607.984070:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484218880 00000100:00100000:2.0:1789302607.984173:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:2.0:1789302607.984186:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+13:10469:x1876219484218880:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789302607.984452:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.984476:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 13 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.984488:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.984548:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 13 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302607.984564:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 13 pid: 9859 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302607.984582:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807705f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505211264:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302607.984740:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805eaa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302607.989714:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807705f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505211264:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302607.989768:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302607.994942:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.995046:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484219008 00000100:00100000:1.0:1789302607.995056:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484219008 00010000:00010000:1.0:1789302607.995101:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 14 pid: 9859 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.995159:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:1.0:1789302607.995171:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+14:2352:x1876219484219008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302607.995187:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302607.995194:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 14 pid: 9859 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.995230:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 14 pid: 9859 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.995251:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11abc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3732 expref: 14 pid: 9859 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.995267:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:1.0:1789302607.995273:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.995306:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.995316:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.995349:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302607.995405:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+13:2352:x1876219484219008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 236us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302607.995414:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00010000:00010000:0.0:1789302607.995660:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.995669:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.995699:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.995709:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.995717:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.995724:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302607.995729:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.995738:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.995750:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:0.0:1789302607.995753:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789302607.995757:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302607.995764:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11afb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302607.995820:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484218880:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 Request processed in 11637us (11889us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789302607.995845:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:0.0:1789302607.999379:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302607.999476:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484219136 00000100:00100000:1.0:1789302607.999486:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484219136 00000100:00100000:1.0:1789302607.999555:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:1.0:1789302607.999567:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484219136:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789302607.999609:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.999648:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.999658:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789302607.999663:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302607.999668:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.999707:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302607.999724:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 7 pid: 6696 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302607.999740:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1876219505211392:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302607.999833:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302608.007605:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1876219505211392:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302608.007636:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302608.009429:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302608.009699:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484219264 00000100:00100000:1.0:1789302608.009709:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484219264 00010000:00010000:1.0:1789302608.009751:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 8 pid: 6696 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302608.009824:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:1.0:1789302608.009837:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484219264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302608.009857:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302608.010241:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 8 pid: 6696 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.010257:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 8 pid: 6696 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.010280:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009f58736/0x20be524657f11aed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b374e expref: 8 pid: 6696 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.011817:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302608.011822:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302608.011831:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.011844:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.011888:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302608.011958:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484219264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2122us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302608.012148:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00010000:00010000:1.0:1789302608.012204:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.012710:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.012746:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.012755:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.012764:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.012770:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302608.012775:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.012782:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.012799:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302608.012808:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000669e5edc/0x20be524657f11b02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302608.012880:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484219136:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 13314us (13508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302608.012889:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 32 00000040:00080000:2.0:1789302608.019766:0:12012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302608.019781:0:12012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789302608.019832:0:12012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789302608.019838:0:12012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302608.022040:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302608.022204:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484219520 00000100:00100000:2.0:1789302608.022220:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484219520 00000100:00100000:0.0:1789302608.023699:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:0.0:1789302608.023717:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+12:10469:x1876219484219520:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789302608.023821:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.023844:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.023858:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.024195:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.024210:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.024219:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789302608.025094:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302608.025211:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.026123:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 13 pid: 5846 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302608.027083:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505211520:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302608.027224:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690b9fb540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302608.047580:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505211520:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302608.047613:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302608.048417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302608.048650:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484219648 00000100:00100000:2.0:1789302608.048666:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484219648 00010000:00010000:2.0:1789302608.048716:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 14 pid: 5846 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302608.048764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:2.0:1789302608.048774:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+14:2353:x1876219484219648:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302608.048792:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302608.048807:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 14 pid: 5846 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.048821:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 14 pid: 5846 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.048847:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11aca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3739 expref: 14 pid: 5846 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.048863:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:2.0:1789302608.048869:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.048879:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.048888:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.048915:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302608.048996:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+13:2353:x1876219484219648:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 222us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302608.049004:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00010000:00010000:3.0:1789302608.049072:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.049084:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302608.049316:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789302608.049473:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789302608.049645:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789302608.049747:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936344e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876219505211648:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789302608.052368:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302608.052589:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693671c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302608.057448:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505211648 00000100:00100000:2.0:1789302608.057461:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505211648 00000100:00100000:2.0:1789302608.057533:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302608.057546:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876219505211648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789302608.057669:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876219505211648:12345-0@lo:1000:mdt00_001.0 Request processed in 127us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302608.057688:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302608.057768:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789302608.057774:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6936345500, transno 4294967303 00000100:00100000:3.0:1789302608.057809:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936344e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876219505211648:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789302608.058551:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789302608.058643:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936344e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876219505211776:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789302608.058688:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302608.058719:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693671c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302608.058754:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505211776 00000100:00100000:0.0:1789302608.058769:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505211776 00000100:00100000:0.0:1789302608.058830:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302608.058838:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876219505211776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789302608.059217:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876219505211776:12345-0@lo:1000:mdt00_001.0 Request processed in 378us (527us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789302608.059226:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302608.062565:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936344e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876219505211776:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789302608.062739:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062753:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062761:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062768:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302608.062773:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062782:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062803:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:2.0:1789302608.062807:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302608.062814:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062821:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11b10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062861:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062868:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062895:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062900:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302608.062903:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062909:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062918:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:2.0:1789302608.062921:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302608.062924:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062931:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11a3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062958:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062985:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.062995:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.063041:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.063071:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 16 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302608.063088:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807705f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505211904:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302608.063199:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805eaa900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302608.069752:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807705f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505211904:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302608.069794:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302608.071713:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302608.071863:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484219776 00000100:00100000:3.0:1789302608.071886:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484219776 00010000:00010000:3.0:1789302608.071937:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 17 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302608.071996:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:3.0:1789302608.072007:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+17:2351:x1876219484219776:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302608.072025:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302608.072033:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 17 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.072046:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 17 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.072073:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f11a5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b371d expref: 17 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.072088:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:3.0:1789302608.072094:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.072119:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.072127:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.072165:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302608.072193:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072202:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072216:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072223:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072231:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072239:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302608.072244:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072264:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072275:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:0.0:1789302608.072278:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302608.072320:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072330:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f11b17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072343:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072350:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072357:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072363:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302608.072366:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302608.072372:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302608.072378:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+16:2351:x1876219484219776:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 372us (674us total) trans 0 rc 0/0 00010000:00010000:0.0:1789302608.072381:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:0.0:1789302608.072383:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789302608.072386:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302608.072387:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00010000:00010000:0.0:1789302608.072403:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11b09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302608.072758:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+15:10469:x1876219484219520:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 49046us (50732us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789302608.072767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 83 00000020:00080000:0.0:1789302608.072771:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789302608.073255:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302608.073263:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789302608.073356:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789302608.073362:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302608.081357:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302608.081639:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484220032 00000100:00100000:3.0:1789302608.081652:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484220032 00000100:00100000:3.0:1789302608.081759:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:3.0:1789302608.081772:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+15:10469:x1876219484220032:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789302608.082592:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789302608.082702:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1789302608.082756:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.082777:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.082791:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.082801:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.082808:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.082822:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302608.082853:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789302608.082956:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+17:10469:x1876219484220032:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 1186us (1612us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789302608.082965:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000020:00080000:3.0:1789302608.082986:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789302608.083068:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302608.083083:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.083106:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302608.083111:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.083123:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.083142:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6904039100) 00010000:00010000:2.0:1789302608.083145:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789302608.083151:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.083157:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11b1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302608.083182:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302608.083197:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302608.083199:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302608.973524:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789302609.102092:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302609.102101:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789302609.102132:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789302609.102138:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789302609.295191:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302609.295211:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505212032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302609.295269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302609.295710:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505212032 00000100:00100000:0.0:1789302609.295718:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505212032 00000100:00100000:0.0:1789302609.295769:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789302609.295778:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876219505212032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302609.295810:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302609.295858:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876219505212032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302609.295865:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789302609.295906:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505212032:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302609.296009:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302609.806008:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505212544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302609.806025:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505212288:0@lo:400:kworker.0 00000100:00100000:2.0:1789302609.806115:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505212160:0@lo:400:kworker.0 00000100:00100000:3.0:1789302609.806471:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505212416:0@lo:400:kworker.0 00000100:00100000:0.0:1789302609.807811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302609.807884:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505212800:0@lo:400:kworker.0 00000100:00100000:0.0:1789302609.807927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302609.807988:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505212800 00000100:00100000:0.0:1789302609.807996:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505212800 00000100:00100000:2.0:1789302609.808142:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302609.808180:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876219505212672:0@lo:400:kworker.0 00000100:00100000:2.0:1789302609.808210:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302609.808245:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505212288 00000100:00100000:2.0:1789302609.808250:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505212288 00000100:00100000:2.0:1789302609.808314:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505212672 00000100:00100000:2.0:1789302609.808318:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505212672 00000100:00100000:0.0:1789302609.808435:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302609.808446:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1876219505212800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302609.808529:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1876219505212800:12345-0@lo:400:kworker.0 Request processed in 86us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302609.808537:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302609.808585:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505212800:0@lo:400:kworker.0 00000100:00100000:2.0:1789302609.808587:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789302609.808802:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505212288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302609.809200:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505212288:12345-0@lo:400:kworker.0 Request processed in 401us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302609.809208:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789302609.809227:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789302609.809236:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876219505212672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302609.809276:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876219505212672:12345-0@lo:400:kworker.0 Request processed in 42us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302609.809431:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1789302609.809632:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302609.809637:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302609.809649:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505212160 00000100:00100000:2.0:1789302609.809656:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505212160 00000100:00100000:2.0:1789302609.810144:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789302609.810152:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505212160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302609.810197:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505212160:12345-0@lo:400:kworker.0 Request processed in 46us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302609.810203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789302609.810259:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505212160:0@lo:400:kworker.0 00000100:00100000:2.0:1789302609.810275:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c372a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876219505212672:0@lo:400:kworker.0 00000100:00100000:2.0:1789302609.810331:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505212288:0@lo:400:kworker.0 00000100:00100000:1.0:1789302609.813383:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302609.814227:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505212544 00000100:00100000:1.0:1789302609.814237:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505212544 00000100:00100000:1.0:1789302609.814317:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789302609.814328:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876219505212544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302609.814367:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302609.814446:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876219505212544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302609.814453:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789302609.815226:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505212544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302609.816702:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302609.821034:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505212416 00000100:00100000:1.0:1789302609.821049:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505212416 00000100:00100000:3.0:1789302609.826948:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789302609.826977:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505212416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302609.827200:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505212416:12345-0@lo:400:kworker.0 Request processed in 239us (10500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302609.827208:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789302609.827258:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505212416:0@lo:400:kworker.0 00000100:00080000:2.0:1789302609.828207:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789302609.892742:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302609.892750:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302609.892785:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789302609.892791:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789302610.007642:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302610.095595:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.095648:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484220288 00000100:00100000:3.0:1789302610.095659:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484220288 00000100:00100000:3.0:1789302610.095733:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:3.0:1789302610.095744:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+17:10487:x1876219484220288:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302610.095767:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302610.095787:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3755 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.095905:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11b2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.095921:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11b2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.095934:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11b2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302610.095945:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789302610.096078:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3755 expref: 20 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.096109:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11b2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3755 expref: 19 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.096119:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302610.096122:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302610.096125:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6000, rc 0) 00000100:00100000:3.0:1789302610.096186:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+19:10487:x1876219484220288:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 444us (598us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789302610.096192:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00080000:0.0:1789302610.096798:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302610.101137:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302610.101374:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484220416 00000100:00100000:1.0:1789302610.101384:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484220416 00000100:00100000:1.0:1789302610.101441:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:1.0:1789302610.101452:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+19:10487:x1876219484220416:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:1.0:1789302610.102144:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102164:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102191:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102207:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102214:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102221:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102791:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102802:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102810:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302610.102856:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102869:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102876:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102884:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102900:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302610.102904:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102912:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102925:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:1.0:1789302610.102928:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302610.102932:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102938:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11b3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102949:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.102956:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106167:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106174:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302610.106180:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106189:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106219:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69051af800) 00010000:00010000:1.0:1789302610.106222:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302610.106227:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106233:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106254:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106261:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106267:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106272:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302610.106275:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106281:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106570:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a69051afa00) 00010000:00010000:1.0:1789302610.106573:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302610.106577:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.106584:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11b48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302610.106742:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+19:10487:x1876219484220416:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 5287us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302610.106752:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:1.0:1789302610.199849:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302610.200074:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484220672 00000100:00100000:2.0:1789302610.200084:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484220672 00000100:00100000:2.0:1789302610.200784:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:2.0:1789302610.200796:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+19:10490:x1876219484220672:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302610.200818:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302610.200839:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11b4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b375c expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.200921:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.200946:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.200968:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.200985:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.200992:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201010:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201274:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201585:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201596:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302610.201607:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789302610.201701:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201709:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201716:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201728:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302610.201733:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201740:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201753:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:2.0:1789302610.201755:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302610.201759:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201765:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201776:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201781:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201787:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201791:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302610.201794:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201799:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201816:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6907c68900) 00010000:00010000:2.0:1789302610.201818:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302610.201821:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.201827:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.202019:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11b4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 22 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.202036:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 21 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.202043:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:2.0:1789302610.202046:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302610.202048:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8200, rc 0) 00000100:00100000:2.0:1789302610.202255:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+21:10490:x1876219484220672:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1461us (2415us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789302610.202265:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:2.0:1789302610.208739:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.209003:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484220800 00000100:00100000:3.0:1789302610.209013:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484220800 00000100:00100000:3.0:1789302610.209076:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 87 00000100:00100000:3.0:1789302610.209087:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+21:10490:x1876219484220800:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:3.0:1789302610.209157:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209188:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209201:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209651:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209724:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209732:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209738:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302610.209743:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209751:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209912:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:3.0:1789302610.209916:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302610.209922:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.209928:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302610.210185:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+21:10490:x1876219484220800:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 1096us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302610.210194:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 87 00000100:00100000:3.0:1789302610.220571:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.220773:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484221056 00000100:00100000:0.0:1789302610.220783:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484221056 00000100:00100000:0.0:1789302610.220843:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:0.0:1789302610.220861:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690631d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+21:10490:x1876219484221056:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789302610.221124:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690631d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+22:10490:x1876219484221056:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 271us (561us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789302610.221132:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789302610.262089:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302610.262254:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484221312 00000100:00100000:2.0:1789302610.262265:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484221312 00000100:00100000:2.0:1789302610.262362:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 88 00000100:00100000:2.0:1789302610.262385:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+22:10011:x1876219484221312:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302610.262410:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302610.262430:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b79 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3763 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.262528:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.262542:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 23 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.262551:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.262583:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 23 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.262596:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 23 pid: 6295 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302610.262608:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505212928:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302610.262702:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805eaa600 going to sleep for 11 seconds 00000100:00100000:2.0:1789302610.266455:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.266543:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484221440 00000100:00100000:0.0:1789302610.266553:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484221440 00010000:00010000:0.0:1789302610.266594:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 24 pid: 6295 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.266631:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:0.0:1789302610.266640:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+24:2352:x1876219484221440:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302610.266654:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302610.266660:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 24 pid: 6295 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.266684:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 24 pid: 6295 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.266704:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302610.266709:0:6712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.266719:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.266726:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.266744:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302610.266795:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+24:2352:x1876219484221440:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 155us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302610.266802:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00010000:00010000:1.0:1789302610.267358:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11b64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b375c expref: 23 pid: 6295 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302610.267376:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505212928:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302610.267396:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.267405:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.267411:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302610.267432:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789302610.267585:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11b79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.267599:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.267606:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:1.0:1789302610.267609:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789302610.267621:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9000, rc 0) 00000100:00100000:1.0:1789302610.267666:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+23:10011:x1876219484221312:12345-192.168.203.42@tcp:101:bash.0 Request processed in 5282us (5588us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789302610.267673:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 88 00000100:00100000:2.0:1789302610.272160:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302610.272244:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484221696 00000100:00100000:1.0:1789302610.272254:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484221696 00000100:00100000:1.0:1789302610.272339:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:1.0:1789302610.272349:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+23:10011:x1876219484221696:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:1.0:1789302610.272599:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.272615:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.272627:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302610.272685:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789302610.272708:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070156165 reply state 0000000092198ac2 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302610.272716:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789302610.272762:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789302610.272850:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+27:10011:x1876219484221696:12345-192.168.203.42@tcp:36:bash.0 Request processed in 502us (698us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789302610.272857:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 89 00000020:00080000:1.0:1789302610.272861:0:6295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789302610.275084:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.275112:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.275121:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.275128:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302610.275132:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.275159:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.275176:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302610.275178:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302610.275183:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.275190:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11b8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302610.277249:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.277391:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484221824 00000100:00100000:0.0:1789302610.277402:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484221824 00000100:00100000:0.0:1789302610.277447:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:0.0:1789302610.277458:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+26:10011:x1876219484221824:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302610.277482:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302610.277501:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11b95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b376a expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.277560:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b376a expref: 27 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.277574:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11b95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b376a expref: 27 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.277593:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302610.277596:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302610.277599:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044000, rc 0) 00000100:00100000:0.0:1789302610.277676:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+27:10011:x1876219484221824:12345-192.168.203.42@tcp:101:bash.0 Request processed in 221us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302610.277683:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:3.0:1789302610.281381:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.281476:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484221952 00000100:00100000:0.0:1789302610.281487:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484221952 00000100:00100000:0.0:1789302610.281561:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:0.0:1789302610.281570:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:10011:x1876219484221952:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302610.281587:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302610.281608:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3771 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302610.281633:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa6974d, atime: 0x6aa6974c, ctime: 0x6aa6974d, blocks: 0xb 00010000:00010000:0.0:1789302610.281652:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1789302610.281656:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302610.281664:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.281681:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.281693:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045600, rc 0) 00000100:00100000:0.0:1789302610.281753:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:10011:x1876219484221952:12345-192.168.203.42@tcp:101:bash.0 Request processed in 184us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302610.281759:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00080000:2.0:1789302610.286710:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302610.288414:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302610.288512:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484222080 00000100:00100000:2.0:1789302610.288522:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484222080 00002000:00010000:2.0:1789302610.288578:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1789302610.288584:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936344700 with x1876219484222080 ext(0->18446744073709551615) 00002000:00010000:2.0:1789302610.288595:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6936344700. 00000100:00100000:2.0:1789302610.288631:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:2.0:1789302610.288640:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484222080:12345-192.168.203.42@tcp:10:bash.0 00002000:00010000:2.0:1789302610.288929:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789302610.288932:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789302605 -> 1789302609 00002000:00010000:2.0:1789302610.288935:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789302604 -> 1789302604 00002000:00010000:2.0:1789302610.288937:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789302605 -> 1789302609 00002000:00010000:2.0:1789302610.288938:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789302610.289001:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484222080:12345-192.168.203.42@tcp:10:bash.0 Request processed in 361us (594us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789302610.289008:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00002000:00010000:2.0:1789302610.289011:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1789302610.289013:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936344700 with x1876219484222080 ext(0->18446744073709551615) 00002000:00010000:2.0:1789302610.289017:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6936344700. 00000100:00100000:3.0:1789302610.358557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.358768:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484222208 00000100:00100000:3.0:1789302610.358778:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484222208 00000100:00100000:3.0:1789302610.358826:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00100000:3.0:1789302610.358836:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+27:10505:x1876219484222208:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:3.0:1789302610.359051:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359069:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359083:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359309:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359318:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359325:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359519:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359528:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359535:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302610.359588:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359599:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359606:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359612:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359617:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302610.359621:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359628:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359640:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302610.359643:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302610.359648:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359654:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ba3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359665:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359671:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359684:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359766:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302610.359769:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359775:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359783:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6904039d00) 00010000:00010000:3.0:1789302610.359785:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302610.359788:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359793:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11baa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359807:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359812:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359818:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359823:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302610.359825:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359840:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359848:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:3.0:1789302610.359850:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302610.359932:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.359939:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302610.360025:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+27:10505:x1876219484222208:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 1188us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302610.360034:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00100000:1.0:1789302610.415127:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.415634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484222464 00000100:00100000:0.0:1789302610.415651:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484222464 00000100:00100000:0.0:1789302610.415917:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 92 00000100:00100000:0.0:1789302610.415929:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+27:10508:x1876219484222464:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302610.415971:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302610.415999:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11bb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3778 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416113:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416132:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416153:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416227:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416236:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416244:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416626:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11bcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416638:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.416645:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302610.416966:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789302610.417212:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417221:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417228:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417236:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302610.417241:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417250:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417266:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:0.0:1789302610.417269:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302610.417275:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417281:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417335:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417342:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417362:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417368:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302610.417371:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417379:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417389:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69061a7600) 00010000:00010000:0.0:1789302610.417391:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302610.417394:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417400:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11bc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417460:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11bb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3778 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417480:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3778 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.417489:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302610.417491:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789302610.417494:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044e00, rc 0) 00000100:00100000:0.0:1789302610.418347:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+29:10508:x1876219484222464:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2412us (3228us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789302610.418373:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 92 00000100:00100000:3.0:1789302610.421422:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.421465:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484222592 00000100:00100000:3.0:1789302610.421475:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484222592 00000100:00100000:3.0:1789302610.421531:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 93 00000100:00100000:3.0:1789302610.421541:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+29:10508:x1876219484222592:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:3.0:1789302610.421611:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.421630:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.421640:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.421683:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.421711:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 29 pid: 5847 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302610.421726:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936345500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505213056:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302610.421804:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789302610.425433:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.425475:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484222848 00000100:00100000:3.0:1789302610.425484:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484222848 00000100:00100000:3.0:1789302610.425538:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:3.0:1789302610.425548:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+30:9260:x1876219484222848:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789302610.425993:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+31:9260:x1876219484222848:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 444us (566us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789302610.426001:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789302610.427943:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936345500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505213056:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302610.427998:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302610.434505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.434585:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484222976 00000100:00100000:3.0:1789302610.434595:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484222976 00010000:00010000:3.0:1789302610.434637:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 31 pid: 5847 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302610.434718:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:3.0:1789302610.434728:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+31:2351:x1876219484222976:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302610.434745:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302610.434754:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 31 pid: 5847 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.434768:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 31 pid: 5847 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.434810:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11b80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3763 expref: 31 pid: 5847 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.434826:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:3.0:1789302610.434832:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.434843:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.434851:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.434883:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302610.434946:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302610.434948:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+30:2351:x1876219484222976:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 219us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302610.434988:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 48 00010000:00010000:0.0:1789302610.434992:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.435044:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.435055:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.435063:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.435072:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302610.435079:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.435101:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.435122:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302610.435127:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302610.435133:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.435158:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11bdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.435254:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+29:10508:x1876219484222592:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 13708us (13834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302610.435265:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 93 00000100:00100000:0.0:1789302610.449708:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.449787:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484223232 00000100:00100000:3.0:1789302610.449798:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484223232 00000100:00100000:3.0:1789302610.449868:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:3.0:1789302610.449879:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+29:10508:x1876219484223232:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789302610.450324:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+30:10508:x1876219484223232:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 445us (623us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789302610.450333:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000001:00080000:2.0:1789302610.487263:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1789302610.487320:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789302610.576597:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302610.576724:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484223488 00000100:00100000:1.0:1789302610.576759:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484223488 00000100:00100000:1.0:1789302610.576851:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 94 00000100:00100000:1.0:1789302610.576863:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+30:10518:x1876219484223488:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1789302610.576889:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302610.576911:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11be2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b377f expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.576997:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.577012:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.577023:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.577037:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.577044:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.577051:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578141:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578156:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578165:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302610.578195:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789302610.578327:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578335:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578342:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578349:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302610.578353:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578361:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578375:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:1.0:1789302610.578378:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302610.578383:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578389:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11be9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578402:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578408:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578422:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578427:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302610.578430:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578435:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578442:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69051afa00) 00010000:00010000:1.0:1789302610.578444:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302610.578446:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578451:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11bf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578510:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11be2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b377f expref: 33 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578525:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b377f expref: 32 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.578532:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:1.0:1789302610.578534:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302610.578536:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9600, rc 0) 00000100:00100000:1.0:1789302610.578615:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+32:10518:x1876219484223488:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1753us (2033us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789302610.578634:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 94 00000100:00100000:1.0:1789302610.583785:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.583879:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484223744 00000100:00100000:3.0:1789302610.583888:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484223744 00000100:00100000:3.0:1789302610.583969:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:3.0:1789302610.583979:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+32:10518:x1876219484223744:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:3.0:1789302610.584264:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+33:10518:x1876219484223744:12345-192.168.203.42@tcp:35:cat.0 Request processed in 286us (487us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789302610.584273:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:0.0:1789302610.627571:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.627658:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484224000 00000100:00100000:3.0:1789302610.627669:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484224000 00000100:00100000:3.0:1789302610.627734:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:3.0:1789302610.627745:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+33:10520:x1876219484224000:12345-192.168.203.42@tcp:36:rm.0 00010000:00010000:3.0:1789302610.627820:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789302610.627850:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11bf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b377f expref: 33 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.627872:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11bcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3778 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.627885:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11b95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b376a expref: 31 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.627895:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:3.0:1789302610.627906:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302610.627928:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.627942:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.627961:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.627991:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.628008:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.628015:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.628260:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.628269:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.628277:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302610.628898:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789302610.628909:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321814622127ns, next at 322814619422ns, rc = 0 00010000:00010000:3.0:1789302610.628984:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.628994:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629001:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629008:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629025:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629031:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629052:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302610.629072:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629077:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629084:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629089:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302610.629094:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629102:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629112:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6904039700) 00010000:00010000:3.0:1789302610.629115:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789302610.629119:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629124:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629140:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629153:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629159:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629164:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302610.629167:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629173:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629181:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302610.629183:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302610.629186:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629190:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302610.629199:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf8687c4 reply state 00000000451cc19e transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302610.629208:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302610.629280:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+32:10520:x1876219484224000:12345-192.168.203.42@tcp:36:rm.0 Request processed in 1535us (1716us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789302610.629322:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 95 00010000:00010000:3.0:1789302610.629375:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302610.629381:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629395:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302610.629398:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629404:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629414:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6904039700) 00010000:00010000:3.0:1789302610.629416:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789302610.629419:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629425:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.629439:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302610.629442:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302610.629444:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302610.637842:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.637868:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.637877:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.637884:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302610.637888:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.637917:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.637933:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6904039d00) 00010000:00010000:3.0:1789302610.637936:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302610.637941:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.637948:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.711223:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.711338:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484224256 00000100:00100000:3.0:1789302610.711348:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484224256 00000100:00100000:3.0:1789302610.711407:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00100000:3.0:1789302610.711416:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+31:10526:x1876219484224256:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789302610.711439:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302610.711459:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3786 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.711571:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.711585:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.711596:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.711610:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.711633:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.711640:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789302610.712183:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789302610.712375:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712385:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712393:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712428:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712435:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712442:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712448:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302610.712452:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712460:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712482:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302610.712484:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302610.712490:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712496:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302610.712509:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b90ceae reply state 00000000a9b3584e transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302610.712517:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789302610.712545:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712558:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.712565:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6904039700) 00010000:00010000:3.0:1789302610.712567:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302610.712569:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7000, rc 0) 00000100:00100000:3.0:1789302610.714538:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+34:10526:x1876219484224256:12345-192.168.203.42@tcp:101:bash.0 Request processed in 3111us (3324us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789302610.714551:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 96 00010000:00010000:0.0:1789302610.719531:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.719550:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.719557:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.719562:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302610.719567:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.719575:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.719590:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6904039d00) 00010000:00010000:0.0:1789302610.719593:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302610.719598:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.719622:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11c2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.726883:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302610.726994:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484224384 00000100:00100000:2.0:1789302610.727010:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484224384 00000100:00100000:2.0:1789302610.727084:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:2.0:1789302610.727094:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484224384:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302610.727111:0:10693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302610.727133:0:10693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b378d expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302610.727178:0:10693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789302610.727199:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1789302610.727203:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302610.727212:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 6 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.727230:0:10693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 6 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.727242:0:10693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8600, rc 0) 00000100:00100000:2.0:1789302610.727341:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484224384:12345-192.168.203.42@tcp:101:bash.0 Request processed in 248us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302610.727347:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00080000:0.0:1789302610.727425:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302610.730961:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.731068:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484224512 00000100:00100000:0.0:1789302610.731078:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484224512 00000100:00100000:0.0:1789302610.731134:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:0.0:1789302610.731143:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:10526:x1876219484224512:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302610.731159:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302610.731178:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3794 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.731207:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 7 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.731216:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302610.731220:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302610.731226:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.731255:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 7 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.731267:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 7 pid: 10693 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.731340:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c372680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876219505213184:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302610.731637:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690350c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302610.735428:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.735511:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484224640 00000100:00100000:3.0:1789302610.735520:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484224640 00010000:00010000:3.0:1789302610.735562:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 8 pid: 10693 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302610.735624:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789302610.735635:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484224640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302610.735650:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302610.735672:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 8 pid: 10693 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.735687:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 8 pid: 10693 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.735710:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302610.735714:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302610.735723:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.735732:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.735768:0:6712:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302610.735782:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c384e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6712:1876219505213312:192.168.203.42@tcp:105: 00000100:00100000:3.0:1789302610.735854:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c840 going to sleep for 11 seconds 00010000:00010000:0.0:1789302610.736202:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcfdb2c0/0x20be524657f11c44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b378d expref: 8 pid: 10693 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.736218:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c372680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876219505213184:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302610.736240:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.736252:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044c00, rc 0) 00000100:00100000:0.0:1789302610.736331:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:10526:x1876219484224512:12345-192.168.203.42@tcp:101:bash.0 Request processed in 5188us (5387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302610.736339:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:3.0:1789302610.738016:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c384e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6712:1876219505213312:192.168.203.42@tcp:105: 00010000:00010000:3.0:1789302610.738053:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302610.738102:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484224640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2468us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302610.738111:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789302610.741043:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.741119:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484224896 00000100:00100000:0.0:1789302610.741130:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484224896 00000100:00100000:0.0:1789302610.741191:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:0.0:1789302610.741202:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+33:10526:x1876219484224896:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:0.0:1789302610.741595:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+34:10526:x1876219484224896:12345-192.168.203.42@tcp:35:bash.0 Request processed in 394us (559us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789302610.741603:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:1.0:1789302610.925326:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302610.925498:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484225024 00000100:00100000:3.0:1789302610.925509:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484225024 00000100:00100000:3.0:1789302610.925572:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:3.0:1789302610.925583:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+34:10542:x1876219484225024:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302610.925606:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302610.925627:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b379b expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.925692:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.925706:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.925719:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302610.925758:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789302610.925761:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302610.925779:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.925804:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b379b expref: 36 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.925843:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b379b expref: 35 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.925851:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302610.925854:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302610.925858:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7c00, rc 0) 00000100:00100000:3.0:1789302610.925920:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+35:10542:x1876219484225024:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 339us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302610.925927:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:1.0:1789302610.935547:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.935718:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484225280 00000100:00100000:0.0:1789302610.935730:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484225280 00000100:00100000:0.0:1789302610.935791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 98 00000100:00100000:0.0:1789302610.935816:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+35:10542:x1876219484225280:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302610.935843:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302610.935864:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11c60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37a2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.935979:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11c67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.935994:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.936005:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302610.936027:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789302610.936152:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11c60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37a2 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.936173:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11c67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37a2 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.936180:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6904039700) 00010000:00010000:0.0:1789302610.936183:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302610.936187:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045e00, rc 0) 00000100:00100000:0.0:1789302610.936250:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+37:10542:x1876219484225280:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 435us (712us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789302610.936257:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 98 00000100:00100000:1.0:1789302610.940698:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302610.940754:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302610.940855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484225664 00000100:00100000:2.0:1789302610.940865:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484225664 00000100:00100000:2.0:1789302610.940930:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:2.0:1789302610.940940:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+37:2351:x1876219484225664:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302610.940965:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302610.940990:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11c67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37a2 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.941008:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6904039700) 00010000:00010000:2.0:1789302610.941012:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302610.941070:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+36:2351:x1876219484225664:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302610.941093:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:3.0:1789302610.941167:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484225536 00000100:00100000:3.0:1789302610.941172:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484225536 00000100:00100000:3.0:1789302610.941211:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:3.0:1789302610.941219:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+36:10542:x1876219484225536:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302610.941239:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302610.941254:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37a9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.941391:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11c7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.941405:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.941416:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302610.941429:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789302610.941601:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11c75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37a9 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.941615:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11c7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37a9 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302610.941622:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6904039700) 00010000:00010000:3.0:1789302610.941624:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789302610.941626:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:3.0:1789302610.941652:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+38:10542:x1876219484225536:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 435us (967us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789302610.941659:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:1.0:1789302610.948993:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302610.949450:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484225792 00000100:00100000:2.0:1789302610.949459:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484225792 00000100:00100000:2.0:1789302610.949565:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:2.0:1789302610.949577:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484225792:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1789302610.949620:0:10693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.949640:0:10693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.949649:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789302610.949653:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302610.949658:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.949699:0:10693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.949714:0:10693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 6 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302610.949729:0:10693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807704e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10693:1876219505213440:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302610.949827:0:10693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805eaa780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302610.954433:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302610.954467:0:10693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807704e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10693:1876219505213440:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302610.954507:0:10693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.954649:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484225920 00000100:00100000:0.0:1789302610.954658:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484225920 00002000:00100000:0.0:1789302610.954714:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a693beaa300 x1876219484225920/t0(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:186/0 lens 504/0 e 0 to 0 dl 1789302621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789302610.954723:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a693beaa300 with x1876219484225920 ext(0->8) 00010000:00010000:0.0:1789302610.954729:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 7 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.954742:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 7 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302610.954749:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a693beaa300 00000100:00100000:0.0:1789302610.954781:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:0.0:1789302610.954790:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484225920:12345-192.168.203.42@tcp:4:lfs.0 00000100:00100000:1.0:1789302610.956242:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484225920:12345-192.168.203.42@tcp:4:lfs.0 Request processed in 1447us (1812us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789302610.956254:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00002000:00100000:1.0:1789302610.956263:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a693beaa300 x1876219484225920/t4294967302(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:186/0 lens 504/448 e 0 to 0 dl 1789302621 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302610.956273:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a693beaa300 with x1876219484225920 ext(0->8) 00010000:00010000:1.0:1789302610.956281:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 9 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.956324:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 9 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302610.956332:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a693beaa300 00000100:00100000:1.0:1789302610.962239:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302610.965562:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484226048 00000100:00100000:2.0:1789302610.965577:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484226048 00010000:00010000:2.0:1789302610.965623:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 9 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302610.965660:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:2.0:1789302610.965669:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484226048:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302610.965685:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789302610.965703:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789302610.965706:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789302609 00002000:00010000:2.0:1789302610.965709:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789302610 00002000:00010000:2.0:1789302610.965711:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789302609 00010000:00010000:2.0:1789302610.965716:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 9 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.965730:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 9 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.965755:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3b5701/0x20be524657f11c4b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3794 expref: 9 pid: 6699 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.965773:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302610.965778:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302610.965799:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.965809:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302610.965914:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302610.965989:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484226048:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 320us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302610.965997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00010000:00010000:1.0:1789302610.971541:0:10693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.971580:0:10693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.971620:0:10693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.971629:0:10693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.971637:0:10693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.971644:0:10693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302610.971648:0:10693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.971657:0:10693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.971676:0:10693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.971685:0:10693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11c8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302610.972395:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2353:x1876219484225792:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 22813us (23404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302610.972406:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:1.0:1789302610.981909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302610.985061:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484226304 00000100:00100000:0.0:1789302610.985077:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484226304 00000100:00100000:0.0:1789302610.985211:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:0.0:1789302610.985222:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690631ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+38:10542:x1876219484226304:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:0.0:1789302610.985304:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11c7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37a9 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302610.987070:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1789302610.987280:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789302610.988590:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1789302610.988665:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.988686:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.988714:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.988755:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.988770:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 42 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.988784:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c372680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1876219505213568:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302610.988873:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690350cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302610.991936:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302610.992037:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484226432 00000100:00100000:1.0:1789302610.992046:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484226432 00010000:00010000:1.0:1789302610.992096:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 43 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302610.992134:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:1.0:1789302610.992143:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+43:2352:x1876219484226432:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302610.992156:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302610.992163:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 43 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.992176:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 43 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.992196:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6904039700) 00010000:00010000:1.0:1789302610.992201:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.992211:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.992219:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302610.992251:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302610.992334:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+43:2352:x1876219484226432:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 191us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302610.992341:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00010000:00010000:0.0:1789302610.993867:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11c36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3786 expref: 42 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302610.993889:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c372680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1876219505213568:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302610.993913:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.993923:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302610.993929:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302610.994084:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789302610.994522:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789302610.994636:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c372680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876219505213696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789302610.994707:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302610.994737:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394e3240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302610.995511:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505213696 00000100:00100000:3.0:1789302610.995523:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505213696 00000100:00100000:3.0:1789302610.995585:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302610.995595:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876219505213696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789302610.999723:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876219505213696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 4109us (4995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302610.999739:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302611.003863:0:5849:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789302611.003876:0:5849:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789302611.003901:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69362d2680, transno 4294967301 00000100:00100000:1.0:1789302611.003925:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c372680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876219505213696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789302611.005323:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789302611.005406:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876219505213824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789302611.005728:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302611.005800:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302611.009687:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505213824 00000100:00100000:0.0:1789302611.009704:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505213824 00000100:00080000:2.0:1789302611.009838:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302611.009900:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302611.009911:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876219505213824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789302611.010566:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1876219505213824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 655us (4835us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789302611.010576:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302611.010687:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1876219505213824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789302611.011034:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1789302611.011084:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.011095:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.011103:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.011109:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302611.011113:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.011121:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.011138:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6904039700) 00010000:00010000:2.0:1789302611.011141:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789302611.011153:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.011159:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f11c91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302611.016062:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789302611.016172:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789302611.016185:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322201898201ns, next at 323201895121ns, rc = 0 00000001:00080000:2.0:1789302611.016195:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789302611.016253:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6904039700) 00010000:00010000:2.0:1789302611.017100:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789302611.017117:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11c7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37a9 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302611.017264:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690631ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+45:10542:x1876219484226304:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 32042us (35362us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789302611.017274:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000020:00080000:2.0:1789302611.017280:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789302611.020860:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302611.021016:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484226560 00000100:00100000:0.0:1789302611.021025:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484226560 00000100:00100000:0.0:1789302611.021134:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:0.0:1789302611.021145:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+45:10542:x1876219484226560:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302611.021169:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302611.021194:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11c98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.021268:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11c98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b0 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.021283:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11c98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b0 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.021341:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:0.0:1789302611.021345:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302611.021348:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044600, rc 0) 00000100:00100000:0.0:1789302611.021412:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+46:10542:x1876219484226560:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 268us (559us total) trans 0 rc 0/0 00010000:00010000:2.0:1789302611.021435:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302611.021435:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:1.0:1789302611.031265:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.031680:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484226816 00000100:00100000:3.0:1789302611.031691:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484226816 00000100:00100000:3.0:1789302611.031794:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:3.0:1789302611.031804:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+46:10542:x1876219484226816:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789302611.032055:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+47:10542:x1876219484226816:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 252us (798us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789302611.032063:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:1.0:1789302611.165471:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302611.165574:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484226944 00000100:00100000:2.0:1789302611.165584:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484226944 00000100:00100000:2.0:1789302611.165643:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 101 00000100:00100000:2.0:1789302611.165655:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+47:10552:x1876219484226944:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:2.0:1789302611.165743:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.165759:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.165788:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.165817:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.165826:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.165832:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.165920:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.165929:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.165936:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302611.166000:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166013:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166020:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166027:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166044:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302611.166048:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166056:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166068:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:2.0:1789302611.166070:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302611.166075:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166080:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11c9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166093:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166100:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166106:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166111:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302611.166114:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166120:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166139:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6907c68900) 00010000:00010000:2.0:1789302611.166141:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302611.166145:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166151:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166167:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166173:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166179:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166184:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302611.166187:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166193:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166200:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:2.0:1789302611.166202:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302611.166205:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.166211:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302611.166361:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+47:10552:x1876219484226944:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 707us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302611.166369:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 101 00000100:00100000:1.0:1789302611.229258:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302611.229471:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484227200 00000100:00100000:2.0:1789302611.229482:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484227200 00000100:00100000:2.0:1789302611.229544:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 102 00000100:00100000:2.0:1789302611.229553:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+47:10555:x1876219484227200:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302611.229574:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302611.229594:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37b7 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229665:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229680:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229692:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229707:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229715:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229721:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229867:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229877:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.229885:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302611.229895:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789302611.230007:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230015:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230023:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230029:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302611.230034:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230042:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230054:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:2.0:1789302611.230058:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302611.230063:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230080:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11cbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230093:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230099:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230106:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230112:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302611.230114:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230121:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230128:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6907c68900) 00010000:00010000:2.0:1789302611.230130:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302611.230133:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230139:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230176:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 50 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230190:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 49 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.230202:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:2.0:1789302611.230205:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302611.230207:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8400, rc 0) 00000100:00100000:2.0:1789302611.230694:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+49:10555:x1876219484227200:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 717us (1020us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789302611.230703:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 102 00000100:00100000:1.0:1789302611.235183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.235280:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484227328 00000100:00100000:3.0:1789302611.235345:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484227328 00000100:00100000:3.0:1789302611.235399:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 103 00000100:00100000:3.0:1789302611.235408:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+49:10555:x1876219484227328:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:3.0:1789302611.235476:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235492:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235503:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235528:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235535:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235542:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235547:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302611.235552:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235559:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235569:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302611.235571:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302611.235576:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.235593:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302611.235656:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+49:10555:x1876219484227328:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 249us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302611.235663:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 103 00000100:00100000:1.0:1789302611.242357:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302611.242448:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484227584 00000100:00100000:2.0:1789302611.242458:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484227584 00000100:00100000:2.0:1789302611.242512:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:2.0:1789302611.242522:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+49:10555:x1876219484227584:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789302611.242754:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+50:10555:x1876219484227584:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 232us (405us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789302611.242762:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:1.0:1789302611.315740:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.316032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484227840 00000100:00100000:3.0:1789302611.316043:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484227840 00000100:00100000:3.0:1789302611.316103:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:3.0:1789302611.316114:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+50:10565:x1876219484227840:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789302611.316138:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302611.316142:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302611.316166:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11c59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b379b expref: 50 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.316187:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302611.316192:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302611.316204:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37be expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.316453:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.316469:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 50 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.316478:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.316518:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 50 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.316531:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 50 pid: 6295 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302611.316544:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c384a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505213952:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302611.316626:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789302611.321102:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.321436:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c384a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505213952:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302611.321461:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302611.325165:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484227968 00000100:00100000:0.0:1789302611.325181:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484227968 00010000:00010000:0.0:1789302611.325233:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 51 pid: 6295 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302611.325305:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:0.0:1789302611.325316:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+51:2352:x1876219484227968:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302611.325356:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302611.325364:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 51 pid: 6295 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.325378:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 51 pid: 6295 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.325401:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b7 expref: 51 pid: 6295 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.325419:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:0.0:1789302611.325425:0:6712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.325433:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.325441:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.325484:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302611.325545:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+50:2352:x1876219484227968:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 230us (4461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302611.325553:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00010000:00010000:3.0:1789302611.326114:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.326123:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302611.326145:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789302611.326331:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11cde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.326348:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.326356:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302611.326358:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302611.326370:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:3.0:1789302611.326406:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+50:10565:x1876219484227840:12345-192.168.203.42@tcp:101:bash.0 Request processed in 10293us (10675us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789302611.326415:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:1.0:1789302611.329927:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.330078:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484228224 00000100:00100000:3.0:1789302611.330088:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484228224 00000100:00100000:3.0:1789302611.330174:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 105 00000100:00100000:3.0:1789302611.330184:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+50:10565:x1876219484228224:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:3.0:1789302611.330585:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.330602:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.330614:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302611.330668:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1789302611.330691:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faf1eb6b reply state 00000000cc415ccf transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302611.330700:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302611.330832:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+53:10565:x1876219484228224:12345-192.168.203.42@tcp:36:bash.0 Request processed in 648us (914us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789302611.330841:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 105 00000020:00080000:3.0:1789302611.330854:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789302611.336753:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.336769:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.336792:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.336809:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302611.336814:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.336823:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.336839:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302611.336842:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302611.336847:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.336853:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11cf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302611.339409:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302611.339535:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484228352 00000100:00100000:2.0:1789302611.339546:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484228352 00000100:00100000:2.0:1789302611.339602:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 106 00000100:00100000:2.0:1789302611.339612:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+52:10565:x1876219484228352:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302611.339635:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302611.339655:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37c5 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.339736:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.339751:0:9859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.339768:0:9859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.339802:0:9859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.339817:0:9859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 53 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302611.339830:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807707800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505214080:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302611.339917:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805eaa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302611.343812:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807707800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505214080:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302611.343844:0:9859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302611.346808:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302611.347585:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484228480 00000100:00100000:2.0:1789302611.347597:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484228480 00010000:00010000:2.0:1789302611.347637:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 54 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302611.347716:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:2.0:1789302611.347726:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+54:2351:x1876219484228480:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302611.347740:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302611.347747:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 54 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.347780:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 54 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.347802:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f11ce5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37be expref: 54 pid: 5845 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.347817:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:2.0:1789302611.347823:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.347833:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.347840:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.347880:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302611.347934:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+53:2351:x1876219484228480:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 210us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302611.347941:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00010000:00010000:0.0:1789302611.348010:0:9859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.348019:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302611.348067:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789302611.348071:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302611.348102:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.348133:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11cfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 53 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.348148:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 52 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.348155:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:0.0:1789302611.348157:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302611.348160:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9200, rc 0) 00000100:00100000:0.0:1789302611.348187:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+52:10565:x1876219484228352:12345-192.168.203.42@tcp:101:bash.0 Request processed in 8577us (8787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302611.348194:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 106 00000100:00100000:1.0:1789302611.352795:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302611.352892:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484228736 00000100:00100000:2.0:1789302611.352902:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484228736 00000100:00100000:2.0:1789302611.353175:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:2.0:1789302611.353187:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+52:10565:x1876219484228736:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:2.0:1789302611.353584:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+53:10565:x1876219484228736:12345-192.168.203.42@tcp:35:bash.0 Request processed in 398us (796us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789302611.353593:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:1.0:1789302611.423966:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.424116:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484228864 00000100:00100000:3.0:1789302611.424127:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484228864 00000100:00100000:3.0:1789302611.424188:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 107 00000100:00100000:3.0:1789302611.424198:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+53:10571:x1876219484228864:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302611.424223:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302611.424243:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37cc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.424327:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.424341:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.424361:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302611.424399:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789302611.424402:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302611.424421:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.424446:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37cc expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.424465:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37cc expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.424473:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302611.424476:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302611.424480:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6600, rc 0) 00000100:00100000:3.0:1789302611.424544:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+54:10571:x1876219484228864:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 347us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302611.424551:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 107 00000100:00100000:1.0:1789302611.431549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.431631:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484228992 00000100:00100000:3.0:1789302611.431640:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484228992 00000100:00100000:3.0:1789302611.431700:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 108 00000100:00100000:3.0:1789302611.431710:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+54:10571:x1876219484228992:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302611.431731:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302611.431753:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37d3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.431836:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.431861:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.431873:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.431888:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.431895:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.431902:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432118:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432127:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432134:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302611.432170:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789302611.432174:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302611.432190:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432213:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432220:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432226:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432232:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432236:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302611.432240:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432247:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432258:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302611.432261:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302611.432265:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432270:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432283:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432314:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432325:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432330:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302611.432333:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432339:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432347:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6904039e00) 00010000:00010000:3.0:1789302611.432349:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302611.432351:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432356:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432392:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37d3 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432406:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37d3 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.432413:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302611.432415:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302611.432417:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6200, rc 0) 00000100:00100000:3.0:1789302611.432478:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+55:10571:x1876219484228992:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 768us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302611.432496:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 108 00000100:00100000:1.0:1789302611.444796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302611.445046:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484229120 00000100:00100000:0.0:1789302611.445068:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484229120 00000100:00100000:0.0:1789302611.445131:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:0.0:1789302611.445141:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+55:2352:x1876219484229120:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302611.445156:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302611.445180:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f11d2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37d3 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.445200:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:0.0:1789302611.445205:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302611.445368:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+54:2352:x1876219484229120:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 227us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302611.445375:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789302611.453397:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302611.453489:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484229376 00000100:00100000:0.0:1789302611.453500:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484229376 00000100:00100000:0.0:1789302611.453559:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 109 00000100:00100000:0.0:1789302611.453580:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+54:10571:x1876219484229376:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302611.453601:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302611.453623:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37da expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.453721:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.453735:0:9859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 55 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.453744:0:9859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.453793:0:9859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 55 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302611.453808:0:9859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 55 pid: 9859 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302611.453821:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c370380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505214208:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302611.453929:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302611.457446:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c370380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505214208:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302611.457483:0:9859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302611.459780:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.459966:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484229504 00000100:00100000:3.0:1789302611.459977:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484229504 00010000:00010000:3.0:1789302611.460282:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 56 pid: 9859 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302611.460345:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:3.0:1789302611.460355:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+56:2352:x1876219484229504:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302611.460369:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302611.460376:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 56 pid: 9859 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.460388:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 56 pid: 9859 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.460409:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37c5 expref: 56 pid: 9859 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.460424:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302611.460429:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.460438:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.460445:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.460502:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302611.460553:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+55:2352:x1876219484229504:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 200us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302611.460561:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00010000:00010000:1.0:1789302611.460671:0:9859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302611.460680:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302611.460698:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789302611.460838:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 56 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302611.460866:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 55 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302611.460875:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:1.0:1789302611.460877:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789302611.460880:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044000, rc 0) 00000100:00100000:1.0:1789302611.460904:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+55:10571:x1876219484229376:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 7337us (7518us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789302611.460912:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 109 00000100:00100000:2.0:1789302611.466273:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.466527:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484229760 00000100:00100000:3.0:1789302611.466537:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484229760 00000100:00100000:3.0:1789302611.466693:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:3.0:1789302611.466705:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+55:10571:x1876219484229760:12345-192.168.203.42@tcp:103:lfs.0 00010000:00010000:3.0:1789302611.466723:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302611.466747:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11c98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37b0 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.466770:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302611.466776:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302611.466838:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+54:10571:x1876219484229760:12345-192.168.203.42@tcp:103:lfs.0 Request processed in 136us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302611.467944:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:1.0:1789302611.470118:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302611.470501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484229888 00000100:00100000:2.0:1789302611.470513:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484229888 00000100:00100000:2.0:1789302611.470582:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 110 00000100:00100000:2.0:1789302611.470593:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+54:10571:x1876219484229888:12345-192.168.203.42@tcp:58:lfs.0 00010000:00010000:2.0:1789302611.470691:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.470708:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302611.470720:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302611.470916:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789302611.471009:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+54:10571:x1876219484229888:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 418us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302611.471017:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 110 00000100:00100000:2.0:1789302611.473812:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302611.473903:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484230016 00000100:00100000:3.0:1789302611.473912:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484230016 00000100:00100000:3.0:1789302611.474035:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 111 00000100:00100000:3.0:1789302611.474047:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+54:10571:x1876219484230016:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302611.474066:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302611.474087:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37e1 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.474158:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.474180:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e1 expref: 55 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.474200:0:6295:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.474215:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e1 expref: 55 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.474229:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302611.474231:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302611.474235:0:6295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e1 expref: 55 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302611.474242:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7c00, rc 0) 00000100:00100000:3.0:1789302611.474341:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+55:10571:x1876219484230016:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 297us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302611.474348:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 111 00010000:00010000:0.0:1789302612.045558:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789302612.173671:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302612.173682:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302612.173723:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789302612.173730:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302612.173848:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c384a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505214336:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789302612.173979:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302612.180619:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.180713:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484230144 00000100:00100000:1.0:1789302612.180733:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484230144 00000100:00100000:1.0:1789302612.180815:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 112 00000100:00100000:1.0:1789302612.180826:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+56:10572:x1876219484230144:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789302612.180871:0:9859:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789302612.180984:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+56:10572:x1876219484230144:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 161us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.180992:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 112 00000100:00080000:2.0:1789302612.181327:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302612.181463:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c384a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505214336:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789302612.191254:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.191692:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484230272 00000100:00100000:3.0:1789302612.191715:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484230272 00000100:00100000:3.0:1789302612.191779:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:3.0:1789302612.191789:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+55:10572:x1876219484230272:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789302612.191857:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.191874:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.191886:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195258:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195282:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195389:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195424:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195434:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195441:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302612.195557:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789302612.195561:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302612.195591:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195603:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195609:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195617:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195623:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302612.195627:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195635:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195645:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:3.0:1789302612.195648:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302612.195653:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195659:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11d55 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195674:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195680:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195686:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195698:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302612.195701:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195708:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195715:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9a6904039e00) 00010000:00010000:3.0:1789302612.195717:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302612.195720:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195726:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11d5c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195741:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195748:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195754:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195759:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302612.195762:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195768:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195785:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302612.195788:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302612.195791:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.195797:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11d63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302612.196215:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+55:10572:x1876219484230272:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 4422us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302612.196226:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 113 00000100:00100000:1.0:1789302612.202863:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.203157:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484230528 00000100:00100000:3.0:1789302612.203167:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484230528 00000100:00100000:3.0:1789302612.203226:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:3.0:1789302612.203236:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+55:10572:x1876219484230528:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302612.203257:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302612.203279:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37e8 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.203393:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.203406:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.203415:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302612.203425:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789302612.205827:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.205844:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.205852:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.205857:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302612.205861:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.205868:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.205883:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302612.205886:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789302612.205891:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.205897:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.206081:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d6a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e8 expref: 57 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.206092:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:3.0:1789302612.206094:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302612.206098:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e8 expref: 57 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.206126:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302612.206274:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+56:10572:x1876219484230528:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 3038us (3417us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1789302612.206282:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 114 00000100:00100000:2.0:1789302612.212250:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302612.212361:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484230656 00000100:00100000:0.0:1789302612.212370:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484230656 00000100:00100000:0.0:1789302612.212432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:0.0:1789302612.212443:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+56:10572:x1876219484230656:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789302612.212480:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789302612.212590:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+56:10572:x1876219484230656:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 148us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302612.212597:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:1.0:1789302612.216628:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.216778:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484230912 00000100:00100000:3.0:1789302612.216789:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484230912 00000100:00100000:3.0:1789302612.216849:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:3.0:1789302612.216860:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+56:10572:x1876219484230912:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302612.216881:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302612.216884:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302612.216912:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37cc expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.216932:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302612.216937:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302612.216961:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37ef expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789302612.219365:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789302612.219625:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.219641:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.219720:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.219804:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37ef expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.219824:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37ef expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.219832:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039e00) 00010000:00010000:3.0:1789302612.219836:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302612.219839:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6a00, rc 0) 00000100:00100000:3.0:1789302612.219917:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+57:10572:x1876219484230912:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 3058us (3299us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1789302612.219925:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:1.0:1789302612.225361:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.225493:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484231168 00000100:00100000:3.0:1789302612.225503:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484231168 00000100:00100000:3.0:1789302612.225563:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:3.0:1789302612.225574:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+57:10572:x1876219484231168:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789302612.225632:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302612.225667:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37ef expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225685:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039e00) 00010000:00010000:3.0:1789302612.225697:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302612.225718:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225733:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225757:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225774:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225782:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225788:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225852:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225859:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225865:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225871:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302612.225876:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225884:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225892:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:3.0:1789302612.225895:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302612.225899:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225910:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11d94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225921:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225927:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225933:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225938:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302612.225941:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225956:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225963:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xef01e9f1 (ffff9a6904039a00) 00010000:00010000:3.0:1789302612.225966:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302612.225968:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.225975:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11d9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xef01e9f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302612.226067:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+56:10572:x1876219484231168:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 495us (715us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302612.226075:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:1.0:1789302612.236469:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.236546:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484231296 00000100:00100000:3.0:1789302612.236556:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484231296 00000100:00100000:3.0:1789302612.236614:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:3.0:1789302612.236624:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+56:10572:x1876219484231296:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302612.236647:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302612.236672:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11da2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37f6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.236707:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.236720:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.236730:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.236846:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.236880:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.236888:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:3.0:1789302612.236891:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789302612.236894:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302612.240264:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+57:10572:x1876219484231296:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 348us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302612.240281:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:1.0:1789302612.241671:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.241813:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484231552 00000100:00100000:3.0:1789302612.241822:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484231552 00000100:00100000:3.0:1789302612.241941:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:3.0:1789302612.241962:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+57:10572:x1876219484231552:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789302612.242246:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.242264:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.242277:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302612.242557:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1789302612.242568:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323428281917ns, next at 324428278587ns, rc = 0 00000004:00010000:3.0:1789302612.242655:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a89859a1 reply state 000000005ca8fd21 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302612.242664:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302612.242770:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+59:10572:x1876219484231552:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 809us (1102us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789302612.242778:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:2.0:1789302612.247559:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.247653:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484231680 00000100:00100000:1.0:1789302612.247663:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484231680 00000100:00100000:1.0:1789302612.247724:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:1.0:1789302612.247733:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+59:10572:x1876219484231680:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302612.247756:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302612.247776:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b37fd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.247838:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.247862:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.247882:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:1.0:1789302612.247885:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302612.247902:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c8c00, rc 0) 00000100:00100000:1.0:1789302612.247971:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+60:10572:x1876219484231680:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 238us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.247978:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 120 00010000:00010000:0.0:1789302612.250422:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.250439:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.250464:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.250471:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302612.250475:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.250484:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.250500:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:0.0:1789302612.250503:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789302612.250507:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.250513:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11db0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.254101:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302612.254243:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484231808 00000100:00100000:2.0:1789302612.254253:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484231808 00000100:00100000:2.0:1789302612.254351:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:2.0:1789302612.254364:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484231808:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789302612.254671:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484231808:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 310us (579us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789302612.254694:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00080000:0.0:1789302612.254784:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302612.266710:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302612.266912:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484232064 00000100:00100000:0.0:1789302612.266923:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484232064 00000100:00100000:0.0:1789302612.266999:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789302612.267011:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+59:10572:x1876219484232064:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789302612.267267:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+60:10572:x1876219484232064:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 257us (566us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789302612.267274:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:3.0:1789302612.278059:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.278251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484232320 00000100:00100000:1.0:1789302612.278260:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484232320 00000100:00100000:1.0:1789302612.278353:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:1.0:1789302612.278364:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+60:10572:x1876219484232320:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789302612.278463:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+60:10572:x1876219484232320:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 101us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.278471:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:1.0:1789302612.281936:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302612.282202:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484232448 00000100:00100000:2.0:1789302612.282212:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484232448 00000100:00100000:2.0:1789302612.282273:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:2.0:1789302612.282321:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+60:10572:x1876219484232448:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302612.282344:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302612.282366:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11dbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3804 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.282437:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11dc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.282451:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.282463:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302612.282502:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302612.282519:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.282543:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11dbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3804 expref: 62 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.282560:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3804 expref: 61 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.282568:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:2.0:1789302612.282583:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789302612.282587:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8200, rc 0) 00000100:00100000:2.0:1789302612.282648:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+61:10572:x1876219484232448:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 365us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302612.282655:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 122 00000100:00100000:0.0:1789302612.286250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.286418:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484232576 00000100:00100000:3.0:1789302612.286427:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484232576 00000100:00100000:3.0:1789302612.286479:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:3.0:1789302612.286487:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484232576:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302612.286503:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302612.286540:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b380b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302612.286566:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa69753, blocks: 0x1 00010000:00010000:3.0:1789302612.286585:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789302612.286590:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302612.286599:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.286617:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.286631:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6600, rc 0) 00000100:00100000:3.0:1789302612.286774:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+10:2351:x1876219484232576:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 286us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302612.286782:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:2.0:1789302612.296708:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.296808:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484232832 00000100:00100000:1.0:1789302612.296819:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484232832 00000100:00100000:1.0:1789302612.296929:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:1.0:1789302612.296940:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+61:10572:x1876219484232832:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789302612.297220:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+61:10572:x1876219484232832:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 281us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.297228:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:2.0:1789302612.300039:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.300169:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484232960 00000100:00100000:3.0:1789302612.300179:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484232960 00000100:00100000:3.0:1789302612.300245:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:3.0:1789302612.300255:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+10:10572:x1876219484232960:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302612.300273:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302612.300316:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3812 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.300345:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.300370:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302612.300374:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302612.300379:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.300410:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.300423:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 11 pid: 6697 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302612.300436:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1876219505214464:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302612.300515:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302612.302336:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1876219505214464:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302612.302368:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.302388:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7000, rc 0) 00000100:00100000:2.0:1789302612.302432:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+11:10572:x1876219484232960:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 2178us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302612.302441:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:3.0:1789302612.304555:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302612.304637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484233088 00000100:00100000:0.0:1789302612.304658:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484233088 00010000:00010000:0.0:1789302612.304698:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 11 pid: 6697 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302612.304738:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:0.0:1789302612.304749:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+11:2352:x1876219484233088:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302612.304762:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302612.304785:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 11 pid: 6697 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.304799:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 11 pid: 6697 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.304821:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001808e1b4/0x20be524657f11dcc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b380b expref: 11 pid: 6697 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.304837:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302612.304850:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302612.304859:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.304869:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.304907:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302612.304934:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c371c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876219505214592:192.168.203.42@tcp:105: 00000100:00100000:0.0:1789302612.305158:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302612.309818:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.309896:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484233216 00000100:00100000:1.0:1789302612.309906:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484233216 00002000:00100000:1.0:1789302612.309971:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a693c384e00 x1876219484233216/t0(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:188/0 lens 504/0 e 0 to 0 dl 1789302623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302612.309982:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a693c384e00 with x1876219484233216 ext(0->12) 00002000:00010000:1.0:1789302612.309992:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a693c384e00 00000100:00100000:1.0:1789302612.310037:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:1.0:1789302612.310047:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ace2f696-3715-4928-b36c-02db3411d1a3+11:2351:x1876219484233216:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789302612.310580:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c371c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876219505214592:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789302612.310604:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302612.311632:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ace2f696-3715-4928-b36c-02db3411d1a3+13:2351:x1876219484233216:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 Request processed in 1581us (1819us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789302612.311644:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00002000:00100000:1.0:1789302612.311654:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a693c384e00 x1876219484233216/t4294967308(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:188/0 lens 504/448 e 0 to 0 dl 1789302623 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302612.311665:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a693c384e00 with x1876219484233216 ext(0->12) 00002000:00010000:1.0:1789302612.311671:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a693c384e00 00000100:00100000:0.0:1789302612.311796:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+12:2352:x1876219484233088:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 7048us (7247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302612.311805:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:3.0:1789302612.314695:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302612.314792:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484233344 00000100:00100000:0.0:1789302612.314802:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484233344 00000100:00100000:0.0:1789302612.314958:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 124 00000100:00100000:0.0:1789302612.314969:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+61:10572:x1876219484233344:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789302612.351028:0:11976:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:1.0:1789302612.351136:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+50:10572:x1876219484233344:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 36159us (36438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.351149:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 124 00000020:00080000:3.0:1789302612.351361:0:11976:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6935fbca80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789302612.351369:0:11976:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a693605e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6935fbc780 00000020:00080000:3.0:1789302612.351373:0:11976:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a693605e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a690b9a7000 00000004:00080000:3.0:1789302612.351428:0:11976:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789302612.351429:0:11977:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789302612.351438:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1789302612.351477:0:11976:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789302612.351500:0:11976:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a693671cf00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789302612.351504:0:11976:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6903fff100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a690350c9c0 00000020:00080000:3.0:1789302612.351526:0:11976:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6903fff600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a690b9a5000 00000020:00080000:1.0:1789302612.351579:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1789302612.351822:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505214848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789302612.351912:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789302612.351986:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789302612.352125:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505214848 00000100:00100000:0.0:1789302612.352136:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505214848 00000100:00100000:0.0:1789302612.352365:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789302612.352377:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876219505214848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789302612.352412:0:10693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789302612.352451:0:10693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.352480:0:10693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.352492:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00000100:00100000:2.0:1789302612.352498:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c371c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505214720:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789302612.352511:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302612.352518:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302612.352541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302612.352555:0:10693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302612.352560:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505214720 00000100:00100000:3.0:1789302612.352566:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505214720 00000100:00100000:2.0:1789302612.352569:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302612.352577:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505214976:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789302612.352579:0:10693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 11 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302612.352602:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789302612.352610:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876219505214720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789302612.352625:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:0.0:1789302612.352657:0:10693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10693:1876219505215104:192.168.203.42@tcp:104: 00002000:00010000:3.0:1789302612.352658:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa69751, atime: 0x6aa69752, ctime: 0x6aa69751, blocks: 0x1 00010000:00010000:3.0:1789302612.352668:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.352680:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1789302612.352683:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302612.352690:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.352710:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.352721:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302612.352730:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302612.352739:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302612.352743:0:10693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69363adc00 going to sleep for 11 seconds 00010000:00010000:3.0:1789302612.352765:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302612.352793:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302612.352812:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.352822:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302612.352827:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.352996:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.353020:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.353075:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f11de1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.353106:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302612.353109:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302612.353110:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302612.353865:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505214720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1252us (1320us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789302612.353877:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789302612.353904:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505214976 00000100:00100000:3.0:1789302612.353910:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505214976 00000100:00100000:3.0:1789302612.353936:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789302612.353954:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505214976:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1789302612.353964:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a693c371c00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789302612.353972:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c371c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505214720:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1789302612.354329:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789302612.354334:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789302611 00002000:00010000:3.0:1789302612.354337:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789302612.354339:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789302611 -> 1789302611 00002000:00010000:3.0:1789302612.354342:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789302612.354393:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1876219505214976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 450us (1655us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789302612.354401:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1789302612.354482:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6903e35f80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1789302612.354489:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505214976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789302612.355067:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302612.355240:0:10693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10693:1876219505215104:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302612.355283:0:10693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302612.355487:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484233472 00000100:00100000:2.0:1789302612.355508:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484233472 00000100:00100000:2.0:1789302612.355604:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:2.0:1789302612.355616:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+12:2354:x1876219484233472:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1789302612.355649:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302612.357679:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.357796:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484233600 00000100:00100000:1.0:1789302612.357808:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484233600 00010000:00010000:1.0:1789302612.357981:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 13 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.358034:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:1.0:1789302612.358045:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+13:2352:x1876219484233600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302612.358063:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302612.358070:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 13 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.358098:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 13 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.358127:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f11b9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3771 expref: 13 pid: 6699 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.358148:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302612.358153:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302612.358160:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.358173:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.358211:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302612.358266:0:10693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.358279:0:10693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.358315:0:10693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.358325:0:10693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.358344:0:10693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789302612.358380:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+12:2352:x1876219484233600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 240us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.358452:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:0.0:1789302612.359111:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1876219505214848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6735us (7197us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789302612.359327:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789302612.359336:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302612.359348:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.359360:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045200 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302612.359365:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.359376:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.359395:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.359403:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11dda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.359423:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302612.359425:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302612.359426:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789302612.360506:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a69362af480/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789302612.360521:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505214848:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789302612.410212:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789302612.410227:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1789302612.410598:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1789302612.410616:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1789302612.410909:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2354:x1876219484233472:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 55290us (55840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302612.410919:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:3.0:1789302612.413665:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.413955:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484233856 00000100:00100000:1.0:1789302612.413964:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484233856 00000100:00100000:1.0:1789302612.414363:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 125 00000100:00100000:1.0:1789302612.414375:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+15:10572:x1876219484233856:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302612.414452:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302612.414479:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11dc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3804 expref: 15 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.414499:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:1.0:1789302612.414505:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302612.414536:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.414551:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.414561:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302612.414811:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7ff9f3b reply state 00000000b7471bcd transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.414820:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302612.414908:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:10572:x1876219484233856:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 534us (1250us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789302612.414916:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 125 00010000:00010000:0.0:1789302612.418254:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.418400:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.418409:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.418416:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302612.418421:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.418432:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.418452:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:0.0:1789302612.418456:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302612.418461:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.418468:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11de8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302612.420620:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302612.420799:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484233984 00000100:00100000:0.0:1789302612.420813:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484233984 00000100:00100000:0.0:1789302612.420891:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:0.0:1789302612.420904:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484233984:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789302612.421405:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789302612.421411:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789302611 -> 1789302610 00002000:00010000:0.0:1789302612.421413:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789302610 00002000:00010000:0.0:1789302612.421426:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789302611 -> 1789302610 00002000:00010000:0.0:1789302612.421438:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789302612.421526:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484233984:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 623us (918us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789302612.421535:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:3.0:1789302612.424471:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.424642:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484234240 00000100:00100000:1.0:1789302612.424656:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484234240 00000100:00100000:1.0:1789302612.424727:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 126 00000100:00100000:1.0:1789302612.424737:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+15:10572:x1876219484234240:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789302612.424804:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.424839:0:9859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.424848:0:9859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.424883:0:9859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.424898:0:9859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 15 pid: 5845 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.424912:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505215232:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302612.425019:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302612.428569:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505215232:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302612.428607:0:9859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302612.429775:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.430121:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484234368 00000100:00100000:1.0:1789302612.430134:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484234368 00010000:00010000:1.0:1789302612.430178:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 16 pid: 5845 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.430225:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789302612.430234:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:2352:x1876219484234368:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302612.430248:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302612.430274:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 16 pid: 5845 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430318:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 16 pid: 5845 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430339:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11da9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37f6 expref: 16 pid: 5845 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430354:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:1.0:1789302612.430359:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430369:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430376:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430410:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302612.430464:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+15:2352:x1876219484234368:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 231us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.430471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00010000:00010000:1.0:1789302612.430497:0:9859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430504:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430533:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430546:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430554:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430559:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302612.430564:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430573:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430584:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:1.0:1789302612.430588:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789302612.430830:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.430840:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11def lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.430883:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+14:10572:x1876219484234240:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 Request processed in 6147us (6427us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789302612.430892:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 126 00000100:00100000:3.0:1789302612.434167:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302612.434242:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484234496 00000100:00100000:0.0:1789302612.434256:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484234496 00000100:00100000:0.0:1789302612.434957:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:0.0:1789302612.434973:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484234496:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789302612.435034:0:10693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.435061:0:10693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.435071:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302612.435077:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302612.435082:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.435126:0:10693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.435144:0:10693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 7 pid: 6696 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302612.435163:0:10693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10693:1876219505215360:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302612.435307:0:10693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302612.440047:0:10693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c371500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10693:1876219505215360:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302612.440094:0:10693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302612.441158:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.441255:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484234624 00000100:00100000:1.0:1789302612.441319:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484234624 00010000:00010000:1.0:1789302612.441374:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 8 pid: 6696 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.441422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:1.0:1789302612.441434:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484234624:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302612.441454:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302612.441484:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 8 pid: 6696 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.441499:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 8 pid: 6696 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.441528:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015f8b9ea/0x20be524657f11dd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3812 expref: 8 pid: 6696 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.441549:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302612.441554:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302612.441559:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.441659:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.441689:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302612.441865:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484234624:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 432us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.441895:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00010000:00010000:0.0:1789302612.442628:0:10693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.442653:0:10693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.443197:0:10693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.443208:0:10693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.443215:0:10693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.443221:0:10693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045200 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302612.443225:0:10693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.443233:0:10693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.443248:0:10693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.443274:0:10693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f11df6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302612.443421:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484234496:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 8449us (9261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302612.443430:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:0.0:1789302612.446487:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.446896:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484234880 00000100:00100000:1.0:1789302612.446912:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484234880 00000100:00100000:1.0:1789302612.447009:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 127 00000100:00100000:1.0:1789302612.447021:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+14:10572:x1876219484234880:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789302612.447127:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.447150:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.447166:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.447459:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.447473:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.447482:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.447526:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.447542:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 15 pid: 5846 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.447716:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505215488:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302612.447828:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302612.451169:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505215488:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302612.451210:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302612.454888:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.455031:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484235008 00000100:00100000:1.0:1789302612.455044:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484235008 00010000:00010000:1.0:1789302612.455100:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 16 pid: 5846 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.455147:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:1.0:1789302612.455159:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+16:2351:x1876219484235008:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302612.455178:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302612.455186:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 16 pid: 5846 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.455200:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 16 pid: 5846 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.455225:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11db7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37fd expref: 16 pid: 5846 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.455245:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:1.0:1789302612.455251:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.455280:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.455340:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.455383:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302612.455423:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.455432:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.455446:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+15:2351:x1876219484235008:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 290us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.455454:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000001:00080000:2.0:1789302612.455686:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789302612.459649:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789302612.459802:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789302612.463134:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c370e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876219505215616:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789302612.463234:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302612.463282:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693d7e9840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302612.463968:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505215616 00000100:00100000:2.0:1789302612.463981:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505215616 00000100:00100000:2.0:1789302612.464273:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302612.464314:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1876219505215616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789302612.466320:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1876219505215616:12345-0@lo:1000:mdt00_002.0 Request processed in 1995us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302612.466340:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302612.466509:0:5847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789302612.466517:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1789302612.466551:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6903e35f80, transno 4294967309 00000100:00100000:0.0:1789302612.466678:0:5847:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a69362af480 x1876219505214848/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789302628 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302612.466694:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c370e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876219505215616:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789302612.467425:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789302612.467535:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c370e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876219505215744:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789302612.467640:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302612.467689:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690b9fb780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302612.467995:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505215744 00000100:00100000:1.0:1789302612.468005:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505215744 00000100:00100000:1.0:1789302612.468061:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789302612.468071:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1876219505215744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789302612.468356:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1876219505215744:12345-0@lo:1000:mdt00_002.0 Request processed in 286us (716us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789302612.468365:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302612.468741:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c370e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876219505215744:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789302612.468814:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.468825:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.468968:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.468978:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302612.469044:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469056:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469076:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:0.0:1789302612.469079:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302612.469085:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469093:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469132:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469138:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469144:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469161:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302612.469165:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469171:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469181:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:0.0:1789302612.469183:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302612.469192:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e1 expref: 18 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469204:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e1 expref: 18 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.469213:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e1 expref: 18 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.469828:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e1 expref: 18 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.469858:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c373b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505215872:192.168.203.42@tcp:105: 00000100:00100000:1.0:1789302612.470142:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690b9fb780 going to sleep for 11 seconds 00000100:00100000:0.0:1789302612.478732:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.479046:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484235136 00000100:00100000:3.0:1789302612.479061:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484235136 00000100:00100000:3.0:1789302612.479140:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:3.0:1789302612.479152:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+19:10571:x1876219484235136:12345-192.168.203.42@tcp:49:lfs.0 00000100:00100000:3.0:1789302612.479379:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+19:10571:x1876219484235136:12345-192.168.203.42@tcp:49:lfs.0 Request processed in 228us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302612.479387:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:1.0:1789302612.480474:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c373b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505215872:192.168.203.42@tcp:105: 00010000:00010000:1.0:1789302612.480513:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480526:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11d47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480587:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480605:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480619:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480632:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480639:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480646:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480653:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302612.480657:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480665:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480677:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:1.0:1789302612.480680:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302612.480685:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480690:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480709:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480715:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480720:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480726:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302612.480728:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480734:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480741:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:1.0:1789302612.480745:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302612.480747:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.480753:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11dfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.481067:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+18:10572:x1876219484234880:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 34047us (34593us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789302612.481078:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 127 00000020:00080000:1.0:1789302612.481084:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789302612.483054:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302612.483066:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789302612.485202:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.486399:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484235392 00000100:00100000:1.0:1789302612.486417:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484235392 00000100:00100000:1.0:1789302612.486571:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 128 00000100:00100000:1.0:1789302612.486585:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:10571:x1876219484235392:12345-192.168.203.42@tcp:58:lfs.0 00000040:00080000:1.0:1789302612.487100:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789302612.487219:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:10571:x1876219484235392:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 636us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.487229:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 128 00000040:00080000:3.0:1789302612.487568:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789302612.487582:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302612.490431:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.491156:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484235648 00000100:00100000:3.0:1789302612.491170:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484235648 00000100:00100000:3.0:1789302612.491238:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:3.0:1789302612.491505:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690631c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+18:10572:x1876219484235648:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789302612.495273:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789302612.495579:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789302612.495668:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.495689:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.495705:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.495715:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.495722:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.495729:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.495825:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789302612.496111:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690631c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+20:10572:x1876219484235648:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 4737us (5568us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789302612.496123:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 32 00000020:00080000:2.0:1789302612.496131:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789302612.498476:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302612.498497:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.498512:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9400 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302612.498518:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.498559:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.498582:0:8459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:0.0:1789302612.498586:0:8459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789302612.498593:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.498598:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11e12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.498627:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302612.498629:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302612.498631:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302612.522545:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302612.522756:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484235776 00000100:00100000:1.0:1789302612.522771:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484235776 00000100:00100000:1.0:1789302612.522852:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:1.0:1789302612.522865:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+20:10574:x1876219484235776:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302612.522898:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302612.522926:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3819 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.523023:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.523043:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.523058:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.523082:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.523089:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.523096:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.524806:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.524833:0:9859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 21 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.524843:0:9859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.524896:0:9859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 21 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302612.524917:0:9859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 21 pid: 9859 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302612.524936:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505216000:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302612.525072:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302612.527950:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c335c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505216000:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302612.527996:0:9859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302612.534968:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302612.538591:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484236032 00000100:00100000:2.0:1789302612.538623:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484236032 00000100:00100000:2.0:1789302612.538731:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:2.0:1789302612.538745:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+22:5590:x1876219484236032:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789302612.539116:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+23:5590:x1876219484236032:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 372us (4162us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789302612.539126:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:3.0:1789302612.547220:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302612.547343:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484236160 00000100:00100000:0.0:1789302612.547358:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484236160 00010000:00010000:0.0:1789302612.547415:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 23 pid: 9859 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302612.547460:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789302612.547471:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+23:2354:x1876219484236160:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302612.547490:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302612.547497:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 23 pid: 9859 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.547571:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 23 pid: 9859 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.547681:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f11d39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37da expref: 23 pid: 9859 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.547705:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:0.0:1789302612.547711:0:6712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.547724:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.547733:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302612.547780:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302612.547853:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+22:2354:x1876219484236160:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 383us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302612.547862:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00010000:00010000:2.0:1789302612.548123:0:9859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548134:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302612.548190:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789302612.548495:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302612.548742:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548760:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548774:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548798:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548805:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548812:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302612.548817:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548825:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548837:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:2.0:1789302612.548840:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302612.548845:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548851:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548867:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548874:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548880:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548886:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302612.548895:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548902:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548910:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a69051af800) 00010000:00010000:2.0:1789302612.548913:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302612.548916:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548923:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.548989:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3819 expref: 22 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.549006:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3819 expref: 21 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302612.549020:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:2.0:1789302612.549022:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302612.549025:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69421c9600, rc 0) 00000100:00100000:2.0:1789302612.549092:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+21:10574:x1876219484235776:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 26230us (26564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302612.549101:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 129 00000100:00100000:3.0:1789302612.844734:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.844792:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.844831:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302612.844874:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484236544 00000100:00100000:3.0:1789302612.844886:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484236544 00000100:00100000:3.0:1789302612.844994:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 137 00000100:00100000:3.0:1789302612.845006:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484236544:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302612.845108:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2353:x1876219484236544:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 104us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302612.845142:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 137 00000100:00080000:3.0:1789302612.845171:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302612.846374:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484236416 00000100:00100000:0.0:1789302612.846389:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484236416 00000100:00100000:0.0:1789302612.846460:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:0.0:1789302612.846471:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2353:x1876219484236416:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302612.846553:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2353:x1876219484236416:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 84us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302612.846560:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00080000:2.0:1789302612.847117:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302612.849388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484236288 00000100:00100000:1.0:1789302612.849410:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484236288 00000100:00100000:1.0:1789302612.849498:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 288 00000100:00100000:1.0:1789302612.849525:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484236288:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302612.849634:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2353:x1876219484236288:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 125us (4840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302612.849653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 288 00010000:00010000:0.0:1789302613.072865:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302613.522448:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302613.522459:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302613.522525:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789302613.522533:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302613.522674:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c370a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505216128:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789302613.522776:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302613.530434:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302613.531009:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c370a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505216128:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789302613.531400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484236672 00000100:00100000:1.0:1789302613.531408:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484236672 00000100:00100000:1.0:1789302613.531458:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:1.0:1789302613.531469:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+21:10585:x1876219484236672:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789302613.531519:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789302613.531621:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+21:10585:x1876219484236672:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 153us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302613.531629:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 130 00000100:00100000:0.0:1789302613.542460:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302613.548011:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484236928 00000100:00100000:3.0:1789302613.548026:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484236928 00000100:00100000:3.0:1789302613.548099:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 131 00000100:00100000:3.0:1789302613.548109:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+21:10585:x1876219484236928:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302613.548129:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302613.548149:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11e35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3820 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302613.548248:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302613.548263:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302613.548276:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302613.548310:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789302613.548437:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11e35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3820 expref: 24 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302613.548455:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3820 expref: 23 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302613.548464:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302613.548468:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302613.548480:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6800, rc 0) 00000100:00100000:3.0:1789302613.548548:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+23:10585:x1876219484236928:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 439us (6096us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789302613.548555:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 131 00000040:00080000:0.0:1789302613.551079:0:12116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302613.551089:0:12116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302613.551138:0:12116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789302613.551145:0:12116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302613.553208:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302613.553251:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484237056 00000100:00100000:3.0:1789302613.553260:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484237056 00000100:00100000:3.0:1789302613.553327:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:3.0:1789302613.553337:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+23:2352:x1876219484237056:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302613.553414:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302613.553439:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3820 expref: 23 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302613.553458:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:3.0:1789302613.553463:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302613.553631:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+22:2352:x1876219484237056:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 293us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302613.553639:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:3.0:1789302613.564909:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302613.565005:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484237312 00000100:00100000:2.0:1789302613.565026:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484237312 00000100:00100000:2.0:1789302613.565088:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 132 00000100:00100000:2.0:1789302613.565099:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+22:10585:x1876219484237312:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789302613.565176:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565202:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565214:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565408:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565416:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565422:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565427:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302613.565431:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565437:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565448:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:2.0:1789302613.565451:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789302613.565455:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302613.565472:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11e4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302613.565617:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+23:10585:x1876219484237312:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 519us (715us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789302613.565625:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 132 00000040:00080000:0.0:1789302613.566580:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302613.566587:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302613.567121:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789302613.567132:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789302613.569141:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302613.570046:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484237568 00000100:00100000:0.0:1789302613.570058:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484237568 00000100:00100000:0.0:1789302613.570127:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:0.0:1789302613.570138:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+23:10585:x1876219484237568:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789302613.570416:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+24:10585:x1876219484237568:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 279us (1281us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789302613.570424:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00010000:00010000:2.0:1789302614.093761:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302614.413887:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505216256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302614.413992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302614.414780:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505216256 00000100:00100000:2.0:1789302614.414790:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505216256 00000100:00100000:2.0:1789302614.414868:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789302614.414880:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505216256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302614.414915:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302614.414997:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505216256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302614.415005:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789302614.415077:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302614.415116:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505216256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302614.925687:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505216384:0@lo:400:kworker.0 00000100:00100000:3.0:1789302614.925759:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302614.925789:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505216768:0@lo:400:kworker.0 00000100:00100000:3.0:1789302614.925814:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505216896:0@lo:400:kworker.0 00000100:00100000:1.0:1789302614.925842:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302614.925889:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302614.925896:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505216384 00000100:00100000:1.0:1789302614.925905:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505216384 00000100:00100000:1.0:1789302614.925962:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789302614.925971:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505216384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302614.926018:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505216384:12345-0@lo:400:kworker.0 Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302614.926025:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789302614.926174:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505216896 00000100:00100000:0.0:1789302614.926179:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505216896 00000100:00100000:0.0:1789302614.926218:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789302614.926226:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505216896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789302614.926255:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302614.926267:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505216896:12345-0@lo:400:kworker.0 Request processed in 41us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302614.926326:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789302614.926641:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505216384:0@lo:400:kworker.0 00000100:00100000:3.0:1789302614.926654:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505216896:0@lo:400:kworker.0 00000100:00100000:1.0:1789302614.928148:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505216512:0@lo:400:kworker.0 00000100:00100000:2.0:1789302614.928184:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505216640:0@lo:400:kworker.0 00000100:00100000:1.0:1789302614.928198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302614.928210:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302614.928222:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505217024:0@lo:400:kworker.0 00000100:00100000:2.0:1789302614.928226:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505217152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302614.928257:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302614.928266:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302614.928307:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505216768 00000100:00100000:2.0:1789302614.928313:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505216768 00000100:00100000:2.0:1789302614.928344:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505217024 00000100:00100000:2.0:1789302614.928346:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505217024 00000100:00100000:2.0:1789302614.928373:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789302614.928381:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505216768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302614.928445:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505216768:12345-0@lo:400:kworker.0 Request processed in 65us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302614.928452:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789302614.929576:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789302614.929590:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69363f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505217024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302614.929656:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69363f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505217024:12345-0@lo:400:kworker.0 Request processed in 71us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302614.929663:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789302614.929799:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505217152 00000100:00100000:2.0:1789302614.929805:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505217152 00000100:00100000:2.0:1789302614.929838:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789302614.929844:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876219505217152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302614.929870:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302614.929906:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876219505217152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302614.929913:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789302614.929942:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302614.929974:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505216512 00000100:00100000:0.0:1789302614.929979:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505216512 00000100:00100000:2.0:1789302614.929980:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505216768:0@lo:400:kworker.0 00000100:00100000:0.0:1789302614.930004:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505216640 00000100:00100000:0.0:1789302614.930007:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505216640 00000100:00100000:2.0:1789302614.930012:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505217024:0@lo:400:kworker.0 00000100:00100000:0.0:1789302614.930031:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789302614.930037:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505216512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302614.930203:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789302614.930207:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505216512:12345-0@lo:400:kworker.0 Request processed in 170us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302614.930212:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505216640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302614.930213:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789302614.930243:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505216640:12345-0@lo:400:kworker.0 Request processed in 33us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302614.930249:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789302614.930273:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505216512:0@lo:400:kworker.0 00000100:00080000:2.0:1789302614.930313:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302614.930317:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505216640:0@lo:400:kworker.0 00000100:00100000:0.0:1789302614.930346:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505217152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789302615.118688:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789302615.524683:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1789302615.524701:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1789302615.524707:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:3.0:1789302615.580683:0:12169:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302615.580692:0:12169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302615.580737:0:12169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789302615.580743:0:12169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302615.764242:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302615.764364:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484237824 00000100:00100000:0.0:1789302615.764374:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484237824 00000100:00100000:0.0:1789302615.764440:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 133 00000100:00100000:0.0:1789302615.764451:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+24:10607:x1876219484237824:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302615.764476:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302615.764495:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11e51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3827 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302615.764589:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11e58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302615.764604:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11e58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302615.764616:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11e58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302615.764638:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789302615.764760:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11e51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3827 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302615.764781:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11e58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3827 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302615.764790:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:0.0:1789302615.764793:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789302615.764797:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045e00, rc 0) 00000100:00100000:0.0:1789302615.764863:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+26:10607:x1876219484237824:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 414us (631us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789302615.764871:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 133 00000100:00080000:2.0:1789302615.765194:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302615.780415:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302615.780538:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484237952 00000100:00100000:1.0:1789302615.780547:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484237952 00000100:00100000:1.0:1789302615.780615:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 134 00000100:00100000:1.0:1789302615.780626:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+26:10607:x1876219484237952:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:1.0:1789302615.780692:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780711:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780722:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780748:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780755:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780763:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780769:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302615.780773:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780780:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780791:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:1.0:1789302615.780794:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302615.780799:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302615.780826:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302615.780890:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+26:10607:x1876219484237952:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 267us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302615.780898:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 134 00000100:00100000:0.0:1789302615.927216:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302615.927428:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484238080 00000100:00100000:2.0:1789302615.927439:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484238080 00000100:00080000:0.0:1789302615.927514:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302615.927525:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:2.0:1789302615.927535:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484238080:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1789302615.927551:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302615.927571:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcfdb2c0/0x20be524657f11e6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b382e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302615.927597:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa69752, atime: 0x6aa69752, ctime: 0x6aa69752, blocks: 0xb 00010000:00010000:2.0:1789302615.927617:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1789302615.927622:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302615.927631:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcfdb2c0/0x20be524657f11e6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b382e expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302615.927650:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcfdb2c0/0x20be524657f11e6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b382e expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302615.927662:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8600, rc 0) 00000100:00100000:2.0:1789302615.927721:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:2353:x1876219484238080:12345-192.168.203.42@tcp:101:cat.0 Request processed in 187us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302615.927728:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:1.0:1789302615.946570:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302615.947193:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484238208 00000100:00100000:2.0:1789302615.947205:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484238208 00002000:00100000:2.0:1789302615.947259:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9a693c76c700 x1876219484238208/t0(0) o3->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:191/0 lens 488/0 e 0 to 0 dl 1789302626 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302615.947275:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a693c76c700 with x1876219484238208 ext(0->4095) 00002000:00010000:2.0:1789302615.947281:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a693c76c700 00000100:00100000:2.0:1789302615.947352:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:2.0:1789302615.947362:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484238208:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:2.0:1789302615.947581:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484238208:12345-192.168.203.42@tcp:3:cat.0 Request processed in 219us (1021us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789302615.947588:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00002000:00100000:2.0:1789302615.947595:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9a693c76c700 x1876219484238208/t0(0) o3->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:191/0 lens 488/4536 e 0 to 0 dl 1789302626 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302615.947602:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a693c76c700 with x1876219484238208 ext(0->4095) 00002000:00010000:2.0:1789302615.947605:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a693c76c700 00010000:00010000:0.0:1789302616.142987:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302617.165892:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789302617.558271:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789302617.558313:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a693d7e9600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789302617.558319:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a693c2cab00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6908464f00 00000020:00080000:3.0:1789302617.558323:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a693c2ca000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a693c360400 00000020:00080000:3.0:1789302617.558346:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789302617.558374:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789302617.558559:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1789302617.566931:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1789302617.566949:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789302617.566955:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1789302617.969067:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302617.969173:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302617.969210:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302617.969239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302617.969270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302617.969847:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484238464 00000100:00100000:3.0:1789302617.969861:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484238464 00000100:00100000:3.0:1789302617.970357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484238848 00000100:00100000:3.0:1789302617.970364:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484238848 00000100:00100000:3.0:1789302617.970420:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:3.0:1789302617.970433:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:2353:x1876219484238464:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:2.0:1789302617.970542:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302617.970816:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:2353:x1876219484238464:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 385us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302617.970826:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:3.0:1789302617.970848:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:3.0:1789302617.970856:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484238848:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302617.970881:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2354:x1876219484238848:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302617.970888:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:3.0:1789302617.971431:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484238592 00000100:00100000:3.0:1789302617.971442:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484238592 00000100:00100000:3.0:1789302617.971735:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484238720 00000100:00100000:3.0:1789302617.971740:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484238720 00000100:00100000:3.0:1789302617.971768:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:3.0:1789302617.971777:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484238592:12345-192.168.203.42@tcp:400:kworker.0 00000100:00080000:2.0:1789302617.971863:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302617.971869:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302617.971915:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2354:x1876219484238592:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 130us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302617.971925:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:0.0:1789302617.972091:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484238336 00000100:00100000:0.0:1789302617.972103:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484238336 00000100:00100000:0.0:1789302617.972143:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 290 00000100:00100000:0.0:1789302617.972154:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2354:x1876219484238336:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302617.972191:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2354:x1876219484238336:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 39us (3137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302617.972199:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 290 00000100:00100000:3.0:1789302617.972235:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:3.0:1789302617.972245:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484238720:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302617.972277:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484238720:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 34us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302617.972306:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00010000:00010000:0.0:1789302618.195500:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302619.216222:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302619.534106:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505217280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302619.534204:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302619.534395:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505217280 00000100:00100000:2.0:1789302619.534406:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505217280 00000100:00100000:2.0:1789302619.534489:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789302619.534501:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505217280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302619.534578:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302619.534643:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505217280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302619.534651:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789302619.534697:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789302619.534704:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789302619.534725:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a693c371c00, transno 4294967304 00000100:00100000:2.0:1789302619.534745:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505217280:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789302619.535375:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789302619.725580:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302619.725591:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302619.725999:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1789302619.726008:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789302620.048036:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505217408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302620.048102:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302620.048245:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505217920:0@lo:400:kworker.0 00000100:00100000:3.0:1789302620.048274:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302620.048310:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302620.048316:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505217792:0@lo:400:kworker.0 00000100:00100000:3.0:1789302620.048340:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302620.048369:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505217920 00000100:00100000:3.0:1789302620.048375:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505217920 00000100:00100000:3.0:1789302620.048424:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789302620.048433:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505217920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302620.048484:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505217920:12345-0@lo:400:kworker.0 Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302620.048491:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789302620.048515:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505217792 00000100:00100000:3.0:1789302620.048518:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505217792 00000100:00100000:3.0:1789302620.048551:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789302620.048558:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505217792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302620.048589:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505217792:12345-0@lo:400:kworker.0 Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302620.048595:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789302620.048636:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505217792:0@lo:400:kworker.0 00000100:00100000:3.0:1789302620.048649:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505217920:0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049075:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505217408 00000100:00100000:2.0:1789302620.049081:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505217408 00000100:00100000:2.0:1789302620.049119:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789302620.049127:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505217408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302620.049156:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302620.049204:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505217408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302620.049210:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789302620.049230:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505217536:0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302620.049303:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505218048:0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049328:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302620.049343:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302620.049348:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505217664:0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049366:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302620.049394:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505217536 00000100:00100000:2.0:1789302620.049398:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505217536 00000100:00100000:2.0:1789302620.049430:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789302620.049448:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505217536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049484:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505217536:12345-0@lo:400:kworker.0 Request processed in 37us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302620.049490:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789302620.049513:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505218048 00000100:00100000:2.0:1789302620.049517:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505218048 00000100:00100000:2.0:1789302620.049539:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505217664 00000100:00100000:2.0:1789302620.049542:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505217664 00000100:00100000:2.0:1789302620.049558:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789302620.049564:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505218048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049595:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505218048:12345-0@lo:400:kworker.0 Request processed in 31us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302620.049600:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789302620.049613:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789302620.049619:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505217664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049644:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505217664:12345-0@lo:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302620.049649:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789302620.049680:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505217664:0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049688:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505217536:0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049697:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505218048:0@lo:400:kworker.0 00000100:00100000:2.0:1789302620.049739:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789302620.049745:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a69362af480, transno 4294967310 00000004:00080000:2.0:1789302620.049756:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789302620.049776:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505217408:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789302620.050665:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302620.050672:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302620.237479:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302620.690962:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302620.691128:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484238976 00000100:00100000:3.0:1789302620.691138:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484238976 00000100:00100000:3.0:1789302620.691215:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 135 00000100:00100000:3.0:1789302620.691226:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:10251:x1876219484238976:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789302620.691717:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:10251:x1876219484238976:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 Request processed in 491us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302620.691740:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 135 00000100:00080000:0.0:1789302620.691812:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302620.706261:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302620.706421:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484239232 00000100:00100000:0.0:1789302620.706431:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484239232 00000100:00100000:0.0:1789302620.706488:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:0.0:1789302620.706500:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:10251:x1876219484239232:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789302620.708174:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+14:10251:x1876219484239232:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 1669us (1914us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789302620.708186:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00010000:00010000:0.0:1789302621.261554:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302622.285578:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789302622.695402:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789302622.695438:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789302622.695456:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789302622.695468:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:3.0:1789302622.852003:0:12370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:30:20 (1789302620) 00000100:00100000:1.0:1789302623.086807:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302623.086853:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302623.086900:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302623.086925:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302623.086971:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302623.087009:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484239360 00000100:00100000:1.0:1789302623.087023:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484239360 00000100:00100000:1.0:1789302623.087098:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 292 00000100:00100000:1.0:1789302623.087111:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484239360:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302623.087197:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484239360:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 88us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302623.087206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 292 00000100:00100000:1.0:1789302623.087246:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484239616 00000100:00100000:1.0:1789302623.087265:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484239616 00000100:00100000:1.0:1789302623.087333:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484239744 00000100:00100000:1.0:1789302623.087337:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484239744 00000100:00100000:1.0:1789302623.087363:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789302623.087371:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484239616:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302623.087420:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484239616:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 49us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302623.087427:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789302623.087440:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:1.0:1789302623.087446:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484239744:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302623.087492:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484239744:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 45us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302623.087498:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:1.0:1789302623.087519:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484239872 00000100:00100000:1.0:1789302623.087523:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484239872 00000100:00100000:1.0:1789302623.087547:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484239488 00000100:00100000:1.0:1789302623.087550:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484239488 00000100:00100000:1.0:1789302623.087569:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 146 00000100:00100000:1.0:1789302623.087575:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484239872:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302623.087605:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484239872:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 30us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302623.087611:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 146 00000100:00100000:1.0:1789302623.087623:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 147 00000100:00100000:1.0:1789302623.087630:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+13:2352:x1876219484239488:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302623.087660:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+13:2352:x1876219484239488:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 31us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302623.087674:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 147 00000100:00080000:1.0:1789302623.087879:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302623.087886:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302623.087889:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789302623.311006:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302624.334617:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302624.465523:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302624.465728:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484240128 00000100:00100000:1.0:1789302624.465742:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484240128 00000100:00100000:1.0:1789302624.465840:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 136 00000100:00100000:1.0:1789302624.465871:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:11319:x1876219484240128:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302624.465900:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302624.466048:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3835 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.466163:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.466181:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.466197:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.466537:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.466561:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.466574:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472360:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f11e89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472384:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f11e89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472397:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f11e89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302624.472416:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789302624.472662:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472670:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472677:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472682:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c8c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302624.472686:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472694:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472706:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:1.0:1789302624.472710:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302624.472714:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.472738:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8c00/0x20be524657f11e7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.476905:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.476923:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.476931:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.476938:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302624.476943:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.476952:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.476970:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a69051af400) 00010000:00010000:1.0:1789302624.476973:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302624.476979:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.476986:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9a00/0x20be524657f11e82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.479542:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c8000/0x20be524657f11e74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3835 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.479569:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f11e89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3835 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.479585:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:1.0:1789302624.479588:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302624.479592:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361ab000, rc 0) 00000100:00100000:1.0:1789302624.479673:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+15:11319:x1876219484240128:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 13822us (14163us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789302624.479682:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 136 00000100:00100000:1.0:1789302624.486266:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302624.486339:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302624.486379:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484240384 00000100:00100000:1.0:1789302624.486389:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484240384 00000100:00100000:1.0:1789302624.486466:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789302624.486483:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+15:2353:x1876219484240384:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302624.486502:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302624.486530:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f11e89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3835 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302624.486548:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:1.0:1789302624.486554:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302624.486610:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+14:2353:x1876219484240384:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 133us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302624.486618:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789302624.486669:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484240256 00000100:00100000:1.0:1789302624.486673:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484240256 00000100:00100000:1.0:1789302624.486707:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 137 00000100:00100000:1.0:1789302624.486715:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+14:11319:x1876219484240256:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789302624.486912:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+14:11319:x1876219484240256:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 184us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302624.486926:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 137 00000100:00100000:2.0:1789302624.654264:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302624.654314:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505218176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302624.654416:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302624.654505:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505218176 00000100:00100000:2.0:1789302624.654524:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505218176 00000100:00100000:2.0:1789302624.654594:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789302624.654604:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505218176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302624.654650:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302624.654703:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505218176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302624.654711:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789302624.654767:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505218176:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789302624.655620:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789302624.845651:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302624.845665:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302624.846185:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789302624.846208:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789302625.167758:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505218560:0@lo:400:kworker.0 00000100:00100000:2.0:1789302625.167868:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302625.168028:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505218432:0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.168064:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302625.168118:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505218944:0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.168148:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302625.168188:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789302625.168195:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505218304:0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.168229:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302625.168249:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505218816:0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.168271:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302625.168328:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505218944 00000100:00100000:1.0:1789302625.168338:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505218944 00000100:00100000:1.0:1789302625.168421:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789302625.168434:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505218944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.168492:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505218944:12345-0@lo:400:kworker.0 Request processed in 62us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302625.168499:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789302625.168524:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505218560 00000100:00100000:1.0:1789302625.168528:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505218560 00000100:00100000:1.0:1789302625.168553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505218432 00000100:00100000:1.0:1789302625.168556:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505218432 00000100:00100000:1.0:1789302625.168568:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505218816 00000100:00100000:1.0:1789302625.168571:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505218816 00000100:00100000:1.0:1789302625.168620:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789302625.168625:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505218560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302625.168776:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505218304 00000100:00100000:0.0:1789302625.168781:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505218304 00000100:00100000:0.0:1789302625.168809:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789302625.168816:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505218304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302625.168873:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505218304:12345-0@lo:400:kworker.0 Request processed in 57us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302625.168880:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789302625.169083:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789302625.169090:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505218432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302625.169133:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505218432:12345-0@lo:400:kworker.0 Request processed in 43us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302625.169141:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789302625.169155:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789302625.169162:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505218816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302625.169186:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505218816:12345-0@lo:400:kworker.0 Request processed in 25us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302625.169192:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1789302625.170090:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789302625.170097:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302625.170173:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505218560:12345-0@lo:400:kworker.0 Request processed in 1545us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302625.170184:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789302625.170236:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505218304:0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.170254:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505218816:0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.170267:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505218432:0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.170278:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505218944:0@lo:400:kworker.0 00000100:00100000:3.0:1789302625.170342:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505218688:0@lo:400:kworker.0 00000100:00100000:3.0:1789302625.170469:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302625.170609:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302625.170616:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505219072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302625.170646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302625.170769:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505218560:0@lo:400:kworker.0 00000100:00100000:1.0:1789302625.171010:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505219072 00000100:00100000:1.0:1789302625.171019:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505219072 00000100:00100000:1.0:1789302625.171075:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789302625.171085:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505219072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302625.171130:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302625.171187:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505219072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302625.171194:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789302625.171614:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505219072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302625.171737:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505218688 00000100:00100000:0.0:1789302625.171745:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505218688 00000100:00100000:0.0:1789302625.172047:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789302625.172057:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505218688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302625.172134:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505218688:12345-0@lo:400:kworker.0 Request processed in 79us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302625.172141:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789302625.172199:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505218688:0@lo:400:kworker.0 00010000:00010000:1.0:1789302625.360486:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302626.382232:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302626.707717:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302626.707809:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484240512 00000100:00100000:0.0:1789302626.707822:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484240512 00000100:00100000:0.0:1789302626.707927:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 138 00000100:00100000:0.0:1789302626.707940:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+14:11362:x1876219484240512:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302626.707967:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302626.708038:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11e97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b383c expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708125:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708161:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708176:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708195:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708203:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708209:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708538:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708547:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708555:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708562:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302626.708567:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708576:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708591:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:0.0:1789302626.708600:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302626.708608:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708615:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708632:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708638:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708644:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708650:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302626.708652:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708658:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708665:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a69061a7c00) 00010000:00010000:0.0:1789302626.708668:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302626.708671:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708676:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ea5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708716:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11e97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b383c expref: 15 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708740:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:0.0:1789302626.708743:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302626.708747:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11e97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b383c expref: 15 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.708757:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045200, rc 0) 00000100:00100000:0.0:1789302626.708832:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+14:11362:x1876219484240512:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 894us (1130us total) trans 0 rc 301/301 00000100:00100000:0.0:1789302626.708840:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 138 00000100:00080000:3.0:1789302626.709527:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302626.727386:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302626.727515:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484240768 00000100:00100000:2.0:1789302626.727529:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484240768 00000100:00100000:2.0:1789302626.727605:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 139 00000100:00100000:2.0:1789302626.727618:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+14:11362:x1876219484240768:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1789302626.727710:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302626.727748:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11823 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b367c expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.727785:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302626.727799:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302626.728103:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.728122:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.728135:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.728148:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.728158:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.728166:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302626.729062:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789302626.729078:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.729087:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.729096:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.729103:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302626.729114:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.729124:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.729137:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:2.0:1789302626.729141:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302626.729145:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.729153:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11eac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302626.729168:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f36fdf7 reply state 000000001d0d2331 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302626.729177:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302626.729314:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+15:11362:x1876219484240768:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 1671us (1916us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789302626.729323:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 139 00010000:00010000:2.0:1789302626.732378:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.732403:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.732413:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.732421:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302626.732427:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.732459:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.732480:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a6907c68a00) 00010000:00010000:2.0:1789302626.732483:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302626.732490:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.732497:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f11eb3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302626.824096:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302626.826250:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484240896 00000100:00100000:3.0:1789302626.826273:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484240896 00000100:00100000:3.0:1789302626.826422:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 140 00000100:00100000:3.0:1789302626.826436:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+14:11370:x1876219484240896:12345-192.168.203.42@tcp:101:lctl.0 00010000:00010000:3.0:1789302626.827210:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302626.827242:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3843 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.827476:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11ec1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.827506:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.827537:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302626.827613:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789302626.827628:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302626.827667:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.827720:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3843 expref: 16 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.828243:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3843 expref: 15 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.828255:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:3.0:1789302626.828258:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302626.828262:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7000, rc 0) 00000100:00100000:3.0:1789302626.829573:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+15:11370:x1876219484240896:12345-192.168.203.42@tcp:101:lctl.0 Request processed in 3121us (5473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302626.829586:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 140 00000100:00100000:3.0:1789302626.914378:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302626.914454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484241024 00000100:00100000:0.0:1789302626.914469:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484241024 00000100:00100000:0.0:1789302626.914556:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:0.0:1789302626.914569:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+15:11376:x1876219484241024:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302626.914599:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302626.914626:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11ec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b384a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914707:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914726:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914741:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914757:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914785:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914792:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914917:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11edd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914926:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.914933:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302626.914969:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789302626.914973:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302626.915006:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915022:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915029:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915037:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915045:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302626.915050:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915066:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915081:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:0.0:1789302626.915085:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302626.915092:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915099:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f11ecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915115:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915121:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915127:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915132:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302626.915135:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915140:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915147:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a69061a7c00) 00010000:00010000:0.0:1789302626.915150:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302626.915153:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915168:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f11ed6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915205:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f11ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b384a expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915222:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b384a expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.915230:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:0.0:1789302626.915233:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789302626.915235:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044600, rc 0) 00000100:00100000:0.0:1789302626.915364:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+16:11376:x1876219484241024:12345-192.168.203.42@tcp:101:bash.0 Request processed in 797us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302626.915373:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 141 00000100:00100000:3.0:1789302626.919221:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302626.919568:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484241280 00000100:00100000:1.0:1789302626.919583:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484241280 00000100:00100000:2.0:1789302626.919717:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 142 00000100:00100000:2.0:1789302626.919740:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+16:11376:x1876219484241280:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302626.919771:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302626.919798:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11ee4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3851 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.919971:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.919990:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.920017:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.920162:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.920182:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.920210:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302626.921332:0:9859:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789302626.922196:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922272:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922314:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922360:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922380:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922388:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922394:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302626.922399:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922406:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922419:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:2.0:1789302626.922422:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302626.922438:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922454:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11eeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302626.922471:0:9859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c6315fb reply state 000000006bcec53b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302626.922479:0:9859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789302626.922519:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11ee4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 19 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922861:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 18 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302626.922869:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:2.0:1789302626.922872:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302626.922875:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8800, rc 0) 00000100:00100000:2.0:1789302626.922957:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+19:11376:x1876219484241280:12345-192.168.203.42@tcp:101:bash.0 Request processed in 3226us (3751us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789302626.922965:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 142 00010000:00010000:3.0:1789302626.925938:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.925962:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.925971:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.925978:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302626.925984:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.925992:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.926011:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6907c68a00) 00010000:00010000:3.0:1789302626.926014:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302626.926020:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302626.926027:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f11ef2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302626.928703:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302626.929147:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484241408 00000100:00100000:1.0:1789302626.929162:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484241408 00000100:00100000:1.0:1789302626.929684:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:1.0:1789302626.929701:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2351:x1876219484241408:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302626.929769:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789302626.930086:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789302626.930373:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3858 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302626.930493:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789302626.930523:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1789302626.930529:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302626.930542:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302626.930568:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302626.930584:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361abc00, rc 0) 00000100:00100000:1.0:1789302626.930672:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484241408:12345-192.168.203.42@tcp:101:bash.0 Request processed in 977us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302626.930682:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:2.0:1789302626.934990:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302626.935791:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484241536 00000100:00100000:1.0:1789302626.935812:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484241536 00000100:00100000:1.0:1789302626.935880:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:1.0:1789302626.935892:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+6:11376:x1876219484241536:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302626.935909:0:10693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302626.935928:0:10693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b385f expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302626.935960:0:10693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302626.935985:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302626.935989:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302626.935995:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 7 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302626.936029:0:10693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302626.936043:0:10693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 7 pid: 6697 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302626.936058:0:10693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936328700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10693:1876219505219200:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302626.938698:0:10693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69037520c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302626.950107:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302626.951432:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484241664 00000100:00100000:0.0:1789302626.951448:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484241664 00010000:00010000:0.0:1789302626.951503:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 8 pid: 6697 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302626.951572:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789302626.951583:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484241664:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302626.951597:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302626.951621:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 8 pid: 6697 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.951654:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 8 pid: 6697 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.951679:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302626.951683:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302626.951692:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 8 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.951702:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 8 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302626.951741:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 8 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302626.951755:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c371180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1876219505219328:192.168.203.42@tcp:105: 00000100:00100000:0.0:1789302626.951862:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69012ed3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789302626.952821:0:10693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6c0467/0x20be524657f11f07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3858 expref: 8 pid: 6697 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302626.952853:0:10693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936328700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10693:1876219505219200:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302626.952884:0:10693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 7 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302626.952896:0:10693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aa800, rc 0) 00000100:00100000:1.0:1789302626.952936:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:11376:x1876219484241536:12345-192.168.203.42@tcp:101:bash.0 Request processed in 17046us (17957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302626.952956:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:0.0:1789302626.963665:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c371180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1876219505219328:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789302626.963702:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302626.964779:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484241664:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 13185us (14676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302626.964796:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:3.0:1789302626.978529:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302626.978692:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484241920 00000100:00100000:1.0:1789302626.978708:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484241920 00000100:00100000:1.0:1789302626.978789:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:1.0:1789302626.978802:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:11376:x1876219484241920:12345-192.168.203.42@tcp:35:bash.0 00000001:00080000:1.0:1789302626.979119:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:1.0:1789302626.979232:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+20:11376:x1876219484241920:12345-192.168.203.42@tcp:35:bash.0 Request processed in 432us (718us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789302626.979240:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00000020:00080000:1.0:1789302626.979245:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789302627.090465:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.090683:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484242176 00000100:00100000:2.0:1789302627.090697:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484242176 00000100:00100000:2.0:1789302627.090789:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 143 00000100:00100000:2.0:1789302627.090812:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+20:11386:x1876219484242176:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302627.090864:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302627.090902:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3866 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302627.091135:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789302627.091405:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11f15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3866 expref: 22 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.091423:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:2.0:1789302627.091426:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302627.091433:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3866 expref: 22 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.091450:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8400, rc 0) 00000100:00100000:2.0:1789302627.091532:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+21:11386:x1876219484242176:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 734us (1081us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1789302627.091541:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 143 00000100:00100000:3.0:1789302627.095156:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302627.100112:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484242432 00000100:00100000:1.0:1789302627.100134:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484242432 00000100:00100000:1.0:1789302627.100225:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:1.0:1789302627.100237:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+21:11386:x1876219484242432:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302627.102704:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+22:11386:x1876219484242432:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 2456us (7552us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789302627.102720:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:0.0:1789302627.210495:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.211198:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484242560 00000100:00100000:2.0:1789302627.211212:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484242560 00000100:00100000:2.0:1789302627.211338:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 144 00000100:00100000:2.0:1789302627.211350:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+22:11392:x1876219484242560:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302627.211384:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302627.211412:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11f23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b386d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.211506:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11f2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.211547:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.211561:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302627.211612:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789302627.211616:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302627.211637:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.211669:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f11f23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b386d expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.211692:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b386d expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.211703:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:2.0:1789302627.211706:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302627.211712:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8e00, rc 0) 00000100:00100000:2.0:1789302627.213477:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+23:11392:x1876219484242560:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2113us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302627.213493:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 144 00000100:00100000:3.0:1789302627.225203:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302627.225816:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484242816 00000100:00100000:1.0:1789302627.225831:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484242816 00000100:00100000:1.0:1789302627.226054:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 145 00000100:00100000:1.0:1789302627.226066:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+23:11392:x1876219484242816:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302627.226097:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302627.226124:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11f31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3874 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.226258:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f11f38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.226493:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f11f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.226512:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f11f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302627.226583:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789302627.226765:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11f31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3874 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.226788:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f11f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3874 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.226798:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:1.0:1789302627.226801:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302627.226806:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361ab400, rc 0) 00000100:00100000:1.0:1789302627.226997:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+25:11392:x1876219484242816:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 932us (1808us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789302627.227006:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 145 00000100:00100000:0.0:1789302627.233227:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302627.233383:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302627.233482:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484243200 00000100:00100000:1.0:1789302627.233496:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484243200 00000100:00100000:1.0:1789302627.233592:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789302627.233605:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+25:2351:x1876219484243200:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302627.233626:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302627.233661:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f11f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3874 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.233716:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:1.0:1789302627.233724:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302627.233807:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+24:2351:x1876219484243200:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 204us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302627.233816:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:3.0:1789302627.237454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484243072 00000100:00100000:3.0:1789302627.237497:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484243072 00000100:00100000:3.0:1789302627.237632:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 146 00000100:00100000:3.0:1789302627.237644:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+24:11392:x1876219484243072:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302627.237677:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302627.237705:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b387b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.237850:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11f4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.237868:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.237891:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302627.238228:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789302627.238429:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b387b expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.238455:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b387b expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.238465:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:3.0:1789302627.238468:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789302627.238471:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7200, rc 0) 00000100:00100000:3.0:1789302627.238554:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+26:11392:x1876219484243072:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 913us (5344us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789302627.238562:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 146 00000100:00100000:1.0:1789302627.248603:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.248872:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484243328 00000100:00100000:2.0:1789302627.248897:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484243328 00000100:00100000:2.0:1789302627.249110:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:2.0:1789302627.249125:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484243328:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:2.0:1789302627.249189:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.249234:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 6 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.249244:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302627.249250:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302627.249255:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.249348:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 6 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.249366:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 6 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302627.249386:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876219505219456:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302627.249509:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906150300 going to sleep for 11 seconds 00000100:00100000:2.0:1789302627.252031:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876219505219456:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302627.252074:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302627.254896:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.262624:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484243456 00000100:00100000:2.0:1789302627.262639:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484243456 00002000:00100000:2.0:1789302627.262698:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a6936329880 x1876219484243456/t0(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:203/0 lens 504/0 e 0 to 0 dl 1789302638 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302627.262729:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936329880 with x1876219484243456 ext(0->12) 00010000:00010000:2.0:1789302627.262739:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 7 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.262756:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 7 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302627.262763:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6936329880 00000100:00100000:2.0:1789302627.262800:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:2.0:1789302627.262810:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484243456:12345-192.168.203.42@tcp:4:lfs.0 00000100:00100000:2.0:1789302627.264362:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:2352:x1876219484243456:12345-192.168.203.42@tcp:4:lfs.0 Request processed in 1545us (9470us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789302627.264373:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00002000:00100000:2.0:1789302627.264383:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a6936329880 x1876219484243456/t4294967305(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:203/0 lens 504/448 e 0 to 0 dl 1789302638 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302627.264393:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936329880 with x1876219484243456 ext(0->12) 00010000:00010000:2.0:1789302627.264403:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 9 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.264419:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 9 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302627.264426:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6936329880 00000100:00100000:0.0:1789302627.267890:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.268008:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484243584 00000100:00100000:2.0:1789302627.268031:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484243584 00010000:00010000:2.0:1789302627.268073:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 9 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302627.268186:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:2.0:1789302627.268197:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+9:2353:x1876219484243584:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302627.268212:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789302627.268232:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789302627.268235:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789302626 00002000:00010000:2.0:1789302627.268238:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789302626 00002000:00010000:2.0:1789302627.268240:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789302626 00010000:00010000:2.0:1789302627.268247:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 9 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.268273:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 9 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.268336:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009df59762/0x20be524657f11f0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b385f expref: 9 pid: 10693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.268353:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302627.268358:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302627.268365:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.268375:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.268410:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302627.268611:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.268633:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.268658:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.268667:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.268676:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.268684:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302627.268688:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.268698:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.268710:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.268719:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9dbf48e/0x20be524657f11f5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302627.268835:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+8:2353:x1876219484243584:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 638us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302627.268853:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:0.0:1789302627.279039:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484243328:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 29903us (30439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302627.279054:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:3.0:1789302627.286275:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302627.286521:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484243840 00000100:00100000:0.0:1789302627.286533:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484243840 00000100:00100000:0.0:1789302627.286586:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:0.0:1789302627.286596:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6904987050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+26:11392:x1876219484243840:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:0.0:1789302627.286671:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b387b expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302627.286951:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789302627.286999:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789302627.287672:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1789302627.287738:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.287755:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 30 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.287764:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.287801:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 30 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.287817:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 30 pid: 9859 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302627.287855:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c371c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876219505219584:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302627.287948:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a691893c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302627.292369:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302627.292504:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484243968 00000100:00100000:3.0:1789302627.292513:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484243968 00010000:00010000:3.0:1789302627.292554:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 31 pid: 9859 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302627.292601:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:3.0:1789302627.292611:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+31:2351:x1876219484243968:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302627.292626:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302627.292633:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 31 pid: 9859 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.292647:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 31 pid: 9859 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.292666:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:3.0:1789302627.292672:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.292681:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.292689:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.292708:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302627.292807:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+31:2351:x1876219484243968:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 197us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302627.292814:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00010000:00010000:0.0:1789302627.294356:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f11ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3851 expref: 30 pid: 9859 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302627.294379:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c371c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876219505219584:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302627.294405:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.294414:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.294419:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302627.294571:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1789302627.294783:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1789302627.294912:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c371c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505219712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789302627.295021:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302627.295069:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302627.295357:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505219712 00000100:00100000:3.0:1789302627.295365:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505219712 00000100:00100000:3.0:1789302627.295426:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789302627.295435:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505219712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789302627.295524:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505219712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302627.295532:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789302627.295893:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302627.295927:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c371c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505219712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789302627.296734:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1789302627.296813:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807705880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505219840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789302627.296872:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302627.297031:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a691893c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302627.301862:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505219840 00000100:00100000:1.0:1789302627.301877:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505219840 00000100:00100000:1.0:1789302627.301985:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302627.301997:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505219840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789302627.302350:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1876219505219840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 355us (5476us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789302627.302358:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789302627.304897:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807705880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505219840:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789302627.304998:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1789302627.305069:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.305080:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.305088:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.305093:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302627.305098:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.305105:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.305121:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:0.0:1789302627.305124:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789302627.305129:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.305136:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f11f62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789302627.306522:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789302627.306639:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789302627.306652:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338492365323ns, next at 339492362841ns, rc = 0 00000001:00080000:0.0:1789302627.306660:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789302627.306713:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68900) 00010000:00010000:0.0:1789302627.306730:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789302627.306739:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f11f4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b387b expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302627.306885:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6904987050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+33:11392:x1876219484243840:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 20287us (20617us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1789302627.306899:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00000020:00080000:0.0:1789302627.306905:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789302627.310184:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.311481:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484244096 00000100:00100000:2.0:1789302627.311495:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484244096 00000100:00100000:2.0:1789302627.311623:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 147 00000100:00100000:2.0:1789302627.311635:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+33:11392:x1876219484244096:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302627.311660:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302627.311684:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11f69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3882 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.311745:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11f69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3882 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.311759:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11f69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3882 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.311778:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302627.311781:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302627.311785:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9200, rc 0) 00000100:00100000:2.0:1789302627.311863:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+34:11392:x1876219484244096:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 231us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302627.311870:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 147 00000100:00100000:1.0:1789302627.320701:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302627.321197:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484244352 00000100:00100000:3.0:1789302627.321207:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484244352 00000100:00100000:3.0:1789302627.321267:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:3.0:1789302627.321278:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+34:11392:x1876219484244352:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789302627.321530:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+35:11392:x1876219484244352:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 253us (838us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789302627.321538:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:0.0:1789302627.395625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302627.395734:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484244608 00000100:00100000:1.0:1789302627.395744:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484244608 00000100:00100000:1.0:1789302627.395813:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 148 00000100:00100000:1.0:1789302627.395823:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+35:11402:x1876219484244608:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302627.395860:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302627.395882:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11f70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3889 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302627.396014:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789302627.396135:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11f70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3889 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.396149:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:1.0:1789302627.396152:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302627.396158:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11f70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3889 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.396171:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361abc00, rc 0) 00000100:00100000:1.0:1789302627.396234:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+36:11402:x1876219484244608:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 412us (617us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1789302627.396242:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 148 00000100:00100000:2.0:1789302627.405606:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:0.0:1789302627.405783:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302627.405850:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484244736 00000100:00100000:3.0:1789302627.405864:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484244736 00000100:00100000:3.0:1789302627.405951:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 149 00000100:00100000:3.0:1789302627.405963:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+36:11402:x1876219484244736:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:3.0:1789302627.406557:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406579:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406593:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406610:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406637:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406644:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406763:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406772:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406779:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302627.406833:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406857:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406864:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406871:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406887:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302627.406892:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406901:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406923:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302627.406926:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302627.406932:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406939:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406959:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406966:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406971:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406977:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302627.406979:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.406986:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407597:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039400) 00010000:00010000:3.0:1789302627.407601:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302627.407606:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407613:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11f85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407648:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407654:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407660:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407664:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302627.407667:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407673:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407681:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302627.407684:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302627.407687:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.407692:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302627.407811:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+36:11402:x1876219484244736:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 1845us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302627.407821:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 149 00000100:00100000:3.0:1789302627.415080:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.415723:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484244992 00000100:00100000:2.0:1789302627.415775:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484244992 00000100:00100000:2.0:1789302627.415862:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:2.0:1789302627.415873:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+36:11402:x1876219484244992:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789302627.416497:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+37:11402:x1876219484244992:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 621us (1428us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789302627.416508:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:2.0:1789302627.450518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302627.459231:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484245248 00000100:00100000:0.0:1789302627.459266:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484245248 00000100:00100000:2.0:1789302627.465670:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 150 00000100:00100000:2.0:1789302627.465698:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+37:11405:x1876219484245248:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302627.465733:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302627.465939:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3890 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466060:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466080:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466093:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466109:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466117:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466122:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466320:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466330:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.466347:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302627.466359:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789302627.467570:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467586:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467593:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467598:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302627.467603:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467612:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467629:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:2.0:1789302627.467632:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302627.467637:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467659:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f11f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467676:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467683:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467689:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467695:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302627.467697:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467703:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467710:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6907c68600) 00010000:00010000:2.0:1789302627.467713:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302627.467715:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467720:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f11fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467911:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467930:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.467943:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302627.467946:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302627.467949:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8200, rc 0) 00000100:00100000:2.0:1789302627.468400:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+39:11405:x1876219484245248:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2714us (17896us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789302627.468425:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 150 00000100:00100000:2.0:1789302627.474613:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302627.474854:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484245376 00000100:00100000:1.0:1789302627.474866:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484245376 00000100:00100000:1.0:1789302627.475033:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:1.0:1789302627.475046:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+39:11405:x1876219484245376:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:1.0:1789302627.475137:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475170:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475185:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475219:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475243:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475251:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475258:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361abc00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302627.475263:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475273:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475317:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:1.0:1789302627.475321:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302627.475328:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.475335:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f11fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302627.475437:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+39:11405:x1876219484245376:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 393us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302627.475445:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:3.0:1789302627.477474:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302627.477678:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484245632 00000100:00100000:0.0:1789302627.477692:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484245632 00000100:00100000:0.0:1789302627.477805:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789302627.477819:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+39:11405:x1876219484245632:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789302627.478329:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+40:11405:x1876219484245632:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 324us (679us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789302627.478338:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:0.0:1789302627.700172:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302627.700321:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484245888 00000100:00100000:3.0:1789302627.700355:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484245888 00000100:00100000:3.0:1789302627.700431:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:3.0:1789302627.700444:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+40:11436:x1876219484245888:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1789302627.700478:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302627.700504:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11fbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3897 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.700635:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11fc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.700654:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.700669:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302627.700683:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789302627.700866:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11fbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3897 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.700894:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3897 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.700904:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302627.700907:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302627.700911:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302627.700991:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+42:11436:x1876219484245888:12345-192.168.203.42@tcp:101:cat.0 Request processed in 549us (835us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789302627.700999:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:3.0:1789302627.706036:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302627.706115:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302627.706156:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484246144 00000100:00100000:1.0:1789302627.706169:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484246144 00000100:00100000:1.0:1789302627.706262:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:1.0:1789302627.706274:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+42:11436:x1876219484246144:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1789302627.706410:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484246272 00000100:00100000:2.0:1789302627.706416:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484246272 00000100:00100000:2.0:1789302627.706466:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:2.0:1789302627.706475:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+43:2352:x1876219484246272:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302627.706496:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302627.706527:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f11fc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3897 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.706553:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302627.706560:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302627.706629:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+42:2352:x1876219484246272:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 155us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302627.706637:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:1.0:1789302627.710019:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+42:11436:x1876219484246144:12345-192.168.203.42@tcp:35:cat.0 Request processed in 3730us (3982us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789302627.710068:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000001:00080000:3.0:1789302627.793701:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967437 is committed 00000004:00080000:3.0:1789302627.793723:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789302627.793751:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a68049cba80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789302627.793758:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6936810200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a68049cb780 00000020:00080000:3.0:1789302627.793761:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6936810500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a693c362400 00000001:00080000:3.0:1789302627.793796:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000020:00080000:1.0:1789302627.793896:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789302627.794153:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789302627.794548:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302627.794576:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505219968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789302627.794664:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302627.795074:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505219968 00000100:00100000:0.0:1789302627.795086:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505219968 00000100:00100000:0.0:1789302627.795336:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789302627.795347:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876219505219968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789302627.795385:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789302627.795433:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa69762, atime: 0x6aa69762, ctime: 0x6aa69762, blocks: 0x1 00010000:00010000:0.0:1789302627.795444:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.795486:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1789302627.795492:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302627.795500:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.795517:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.795528:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.795537:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302627.795567:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302627.796262:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302627.796273:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.796309:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302627.796315:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.796326:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.796348:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.796355:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f11fd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.796378:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302627.796380:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302627.796390:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302627.797586:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505219968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2230us (2912us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789302627.797601:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1789302627.798402:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a693c50ca80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789302627.798417:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505219968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789302627.798555:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302627.798709:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484246528 00000100:00100000:3.0:1789302627.798718:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484246528 00000100:00100000:3.0:1789302627.798784:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 153 00000100:00100000:3.0:1789302627.798795:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+17:11442:x1876219484246528:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:3.0:1789302627.798856:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302627.798866:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302627.798906:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f11f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b386d expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.798927:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302627.798932:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302627.798949:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11fd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b389e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.799086:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.799101:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.799111:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.799149:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302627.799191:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 17 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302627.799207:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505220096:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302627.799451:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302627.804376:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.804646:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fdc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505220096:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302627.804703:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302627.805276:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484246656 00000100:00100000:1.0:1789302627.805319:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484246656 00010000:00010000:1.0:1789302627.805375:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 18 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302627.805428:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:1.0:1789302627.805441:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:2352:x1876219484246656:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302627.805461:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302627.805474:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 18 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.805487:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 18 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.805517:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f11fa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3890 expref: 18 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.805539:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:1.0:1789302627.805545:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.805556:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.805565:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302627.805608:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302627.805677:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+17:2352:x1876219484246656:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 238us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302627.805685:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00010000:00010000:2.0:1789302627.805825:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.805844:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302627.805867:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789302627.806196:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f11fd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.806219:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.806226:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302627.806229:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789302627.806232:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6800, rc 0) 00000100:00100000:2.0:1789302627.806262:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+17:11442:x1876219484246528:12345-192.168.203.42@tcp:101:dd.0 Request processed in 7469us (7712us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789302627.806269:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 153 00000100:00100000:1.0:1789302627.810653:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302627.810765:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484246912 00000100:00100000:2.0:1789302627.810779:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484246912 00000100:00100000:2.0:1789302627.810859:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 154 00000100:00100000:2.0:1789302627.810871:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+17:11442:x1876219484246912:12345-192.168.203.42@tcp:36:dd.0 00010000:00010000:2.0:1789302627.811256:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.811336:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.811349:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302627.811414:0:9859:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1789302627.811442:0:9859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2eb7fd2 reply state 00000000eb8d507d transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302627.811452:0:9859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302627.811576:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+20:11442:x1876219484246912:12345-192.168.203.42@tcp:36:dd.0 Request processed in 704us (940us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1789302627.811586:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 154 00000020:00080000:2.0:1789302627.811593:0:9859:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789302627.819277:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.819341:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.819352:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.819360:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302627.819367:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.819376:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.819439:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302627.819442:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302627.819448:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302627.819455:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f11fee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302628.163243:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.163449:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484247040 00000100:00100000:3.0:1789302628.163463:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484247040 00000100:00100000:3.0:1789302628.163582:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 155 00000100:00100000:3.0:1789302628.163596:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+19:11456:x1876219484247040:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:3.0:1789302628.163629:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302628.163657:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38a5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.163746:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.163764:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.163778:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.163794:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.163802:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789302628.164061:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302628.164215:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.164602:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.164617:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.164627:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.164669:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.164686:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 20 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302628.164702:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505220224:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302628.165398:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302628.172275:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505220224:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302628.172360:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302628.172481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302628.173016:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484247296 00000100:00100000:0.0:1789302628.173029:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484247296 00000100:00100000:0.0:1789302628.173121:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:0.0:1789302628.173133:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+21:5591:x1876219484247296:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789302628.173623:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+22:5591:x1876219484247296:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 489us (1141us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789302628.173653:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:3.0:1789302628.175443:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302628.175962:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484247424 00000100:00100000:0.0:1789302628.175977:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484247424 00010000:00010000:0.0:1789302628.176031:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 22 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302628.176197:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:0.0:1789302628.176211:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+22:2351:x1876219484247424:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302628.176235:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302628.176244:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 22 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.176261:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 22 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.176327:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f11fe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b389e expref: 22 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.176354:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:0.0:1789302628.176360:0:6712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.176374:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.176382:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.176459:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302628.176524:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+21:2351:x1876219484247424:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 316us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302628.176532:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00010000:00010000:3.0:1789302628.177948:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.177969:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302628.178036:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789302628.178041:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302628.178095:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178127:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178138:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178145:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178153:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178160:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.178166:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178176:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178194:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302628.178197:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.178203:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178211:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f11ffc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178232:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178239:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178253:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178260:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.178263:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178271:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178280:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039400) 00010000:00010000:3.0:1789302628.178282:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.178345:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178352:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178406:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f11ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38a5 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178424:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38a5 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.178431:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.178433:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302628.178436:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:3.0:1789302628.178517:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+20:11456:x1876219484247040:12345-192.168.203.42@tcp:101:stat.0 Request processed in 14923us (15290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302628.178537:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 155 00000100:00100000:3.0:1789302628.207340:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.207393:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.207436:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.207463:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.207488:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302628.207591:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484247680 00000100:00100000:2.0:1789302628.207605:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484247680 00000100:00100000:2.0:1789302628.207681:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484248064 00000100:00100000:2.0:1789302628.207684:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484248064 00000100:00100000:2.0:1789302628.207735:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:2.0:1789302628.207748:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+20:2351:x1876219484247680:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302628.207887:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+20:2351:x1876219484247680:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 141us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302628.207895:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 151 00000100:00100000:2.0:1789302628.207916:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:2.0:1789302628.207922:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484248064:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302628.207949:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484248064:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302628.207956:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 152 00000100:00100000:1.0:1789302628.207961:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484247936 00000100:00100000:1.0:1789302628.207967:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484247936 00000100:00080000:2.0:1789302628.208005:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302628.208007:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484247808 00000100:00080000:2.0:1789302628.208011:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302628.208012:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484247808 00000100:00100000:1.0:1789302628.208047:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:1.0:1789302628.208056:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484247936:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302628.208201:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:2.0:1789302628.208211:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484247808:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302628.208227:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2351:x1876219484247936:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 35us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302628.208237:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:2.0:1789302628.208252:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484247808:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 41us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302628.208261:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00080000:1.0:1789302628.208272:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302628.208713:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484247552 00000100:00100000:0.0:1789302628.208720:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484247552 00000100:00100000:0.0:1789302628.208767:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 294 00000100:00100000:0.0:1789302628.208777:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484247552:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302628.208824:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484247552:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 49us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302628.208839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 294 00000100:00100000:2.0:1789302628.247122:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.249235:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484248320 00000100:00100000:3.0:1789302628.249258:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484248320 00000100:00100000:3.0:1789302628.249397:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 156 00000100:00100000:3.0:1789302628.249411:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+20:11462:x1876219484248320:12345-192.168.203.42@tcp:36:truncate.0 00010000:00010000:3.0:1789302628.249488:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302628.249524:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1200a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38a5 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.249554:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.249561:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302628.252221:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.252251:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.252265:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302628.252359:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1789302628.252389:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da9ef5dc reply state 00000000590d81ef transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302628.252423:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789302628.252585:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+22:11462:x1876219484248320:12345-192.168.203.42@tcp:36:truncate.0 Request processed in 3172us (5473us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1789302628.252597:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 156 00000020:00080000:3.0:1789302628.252605:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789302628.257512:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.257535:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.257545:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.257552:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.257559:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.257567:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.257589:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.257593:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.257600:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.257607:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12011 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.432971:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302628.437129:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302628.437500:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484248448 00000100:00100000:0.0:1789302628.437513:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484248448 00000100:00100000:0.0:1789302628.437589:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 157 00000100:00100000:0.0:1789302628.437602:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+21:11475:x1876219484248448:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:0.0:1789302628.437707:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302628.437737:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38ac expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.437920:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.437939:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.437954:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.437993:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.438000:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.438008:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.438603:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.438614:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.438622:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302628.439704:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789302628.439713:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302628.439746:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440114:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440135:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440143:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440176:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440183:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302628.440189:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440199:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440217:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:0.0:1789302628.440221:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302628.440227:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440235:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1201f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440398:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440405:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440412:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440417:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302628.440421:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440438:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440447:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a69061a7100) 00010000:00010000:0.0:1789302628.440450:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302628.440453:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440460:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440516:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 23 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440532:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 22 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.440539:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:0.0:1789302628.440541:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302628.440544:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045200, rc 0) 00000100:00100000:0.0:1789302628.440778:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+22:11475:x1876219484248448:12345-192.168.203.42@tcp:101:stat.0 Request processed in 3176us (3661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302628.440865:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 157 00000100:00100000:2.0:1789302628.528421:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.528577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484248704 00000100:00100000:3.0:1789302628.528608:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484248704 00000100:00100000:3.0:1789302628.528698:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 158 00000100:00100000:3.0:1789302628.528709:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+22:11486:x1876219484248704:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302628.528736:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302628.528773:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302628.528901:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789302628.529067:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12034 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38b3 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.529216:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:3.0:1789302628.529220:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302628.529228:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38b3 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.529251:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6600, rc 0) 00000100:00100000:3.0:1789302628.529392:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+23:11486:x1876219484248704:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 683us (984us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1789302628.529399:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 158 00000100:00100000:2.0:1789302628.533559:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302628.533723:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484248960 00000100:00100000:0.0:1789302628.533736:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484248960 00000100:00100000:0.0:1789302628.533816:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:0.0:1789302628.533828:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6904984450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+23:11486:x1876219484248960:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789302628.534173:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6904984450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+24:11486:x1876219484248960:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 347us (629us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789302628.534181:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:0.0:1789302628.604097:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302628.604272:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484249216 00000100:00100000:2.0:1789302628.604340:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484249216 00000100:00100000:2.0:1789302628.604418:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 159 00000100:00100000:2.0:1789302628.604432:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+24:11492:x1876219484249216:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302628.604465:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302628.604503:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12042 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38ba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.604641:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.604660:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 25 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.604670:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.604737:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 25 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.604765:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 25 pid: 6295 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302628.604794:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693632b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505220352:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302628.604932:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69061506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302628.610762:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693632b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505220352:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302628.610812:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302628.611921:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302628.612382:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484249344 00000100:00100000:1.0:1789302628.612394:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484249344 00010000:00010000:1.0:1789302628.612456:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 26 pid: 6295 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302628.612546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:1.0:1789302628.612569:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+26:2352:x1876219484249344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302628.612589:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302628.612597:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 26 pid: 6295 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302628.612631:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 26 pid: 6295 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302628.612659:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f1202d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ac expref: 26 pid: 6295 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302628.612679:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:1.0:1789302628.612685:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302628.612696:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302628.612706:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302628.612750:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302628.612883:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+25:2352:x1876219484249344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 317us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302628.612891:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00010000:00010000:3.0:1789302628.612952:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.612962:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302628.612996:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789302628.613202:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12042 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.613221:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.613230:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.613232:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302628.613235:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9400, rc 0) 00000100:00100000:3.0:1789302628.613267:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+25:11492:x1876219484249216:12345-192.168.203.42@tcp:101:bash.0 Request processed in 8839us (9196us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789302628.613275:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 159 00000100:00100000:2.0:1789302628.618744:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302628.619023:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484249600 00000100:00100000:0.0:1789302628.619127:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484249600 00000100:00100000:0.0:1789302628.620684:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 160 00000100:00100000:0.0:1789302628.620711:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693632b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+25:11492:x1876219484249600:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:0.0:1789302628.621467:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.621491:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.621506:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302628.621576:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1789302628.621608:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f16de366 reply state 000000007c99beea transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302628.621618:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302628.621739:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693632b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+28:11492:x1876219484249600:12345-192.168.203.42@tcp:36:bash.0 Request processed in 1037us (3005us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789302628.621748:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 160 00000020:00080000:0.0:1789302628.621754:0:6295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789302628.625058:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.625090:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.625100:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.625106:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.625112:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.625120:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.625177:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.625181:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.625187:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.625561:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12057 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302628.630744:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.630928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484249728 00000100:00100000:3.0:1789302628.630943:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484249728 00000100:00100000:3.0:1789302628.631257:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 161 00000100:00100000:3.0:1789302628.631274:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+27:11492:x1876219484249728:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789302628.631340:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302628.631377:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1205e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38c1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.631489:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.631507:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.631518:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.631561:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.631578:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 28 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302628.631614:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505220480:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302628.631730:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302628.639275:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fdfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505220480:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302628.639342:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302628.639935:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.640123:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484249856 00000100:00100000:3.0:1789302628.640134:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484249856 00010000:00010000:3.0:1789302628.641043:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 29 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302628.641090:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:3.0:1789302628.641104:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+29:2351:x1876219484249856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302628.641125:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302628.641134:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 29 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.641147:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 29 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.644050:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12049 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38ba expref: 29 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.644079:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.644087:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.644126:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.644137:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.645990:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.646015:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.646066:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302628.646202:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+28:2351:x1876219484249856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 5089us (6256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302628.646216:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 67 00000004:00200000:2.0:1789302628.646307:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789302628.646313:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302628.646344:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.646459:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1205e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38c1 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.646488:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38c1 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302628.646522:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:2.0:1789302628.646526:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302628.646530:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:2.0:1789302628.646559:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+27:11492:x1876219484249728:12345-192.168.203.42@tcp:101:bash.0 Request processed in 15290us (15833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302628.646568:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 161 00000100:00100000:2.0:1789302628.651471:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302628.651667:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484250112 00000100:00100000:0.0:1789302628.651683:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484250112 00000100:00100000:0.0:1789302628.651780:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:0.0:1789302628.651792:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+27:11492:x1876219484250112:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:0.0:1789302628.652804:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+28:11492:x1876219484250112:12345-192.168.203.42@tcp:35:bash.0 Request processed in 1008us (1343us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789302628.652815:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:0.0:1789302628.775946:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.776602:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484250368 00000100:00100000:3.0:1789302628.776618:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484250368 00000100:00100000:3.0:1789302628.776699:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 162 00000100:00100000:3.0:1789302628.776712:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+28:11502:x1876219484250368:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302628.777952:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302628.778008:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1206c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38c8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302628.778736:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789302628.780143:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1206c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38c8 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.780945:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:3.0:1789302628.780950:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302628.780959:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1206c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38c8 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.781509:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6200, rc 0) 00000100:00100000:3.0:1789302628.781714:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+29:11502:x1876219484250368:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 5000us (5974us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1789302628.781726:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 162 00000100:00100000:2.0:1789302628.802629:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.802816:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484250496 00000100:00100000:3.0:1789302628.802839:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484250496 00000100:00100000:3.0:1789302628.803059:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 163 00000100:00100000:3.0:1789302628.803073:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+29:11502:x1876219484250496:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:3.0:1789302628.803191:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803213:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803228:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803247:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803255:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803262:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803668:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803688:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302628.803752:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803768:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803774:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803782:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803789:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.803793:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803802:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803816:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302628.803820:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.803839:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803847:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1207a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803865:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803871:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803883:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803888:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.803891:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803909:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803918:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039400) 00010000:00010000:3.0:1789302628.803921:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.803924:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803929:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803944:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803950:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803957:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803962:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.803965:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803982:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.803990:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.803993:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.803996:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.804002:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302628.804109:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+29:11502:x1876219484250496:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 1035us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302628.804118:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 163 00000100:00100000:2.0:1789302628.814569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302628.817119:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484250752 00000100:00100000:1.0:1789302628.817142:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484250752 00000100:00100000:1.0:1789302628.817235:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:1.0:1789302628.817249:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+29:11502:x1876219484250752:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302628.817603:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+30:11502:x1876219484250752:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 355us (3047us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789302628.817612:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:2.0:1789302628.886544:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.886929:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484251008 00000100:00100000:3.0:1789302628.886944:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484251008 00000100:00100000:3.0:1789302628.887031:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 164 00000100:00100000:3.0:1789302628.887043:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+30:11505:x1876219484251008:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302628.887075:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302628.887103:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f1208f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38cf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.887448:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.887467:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.887483:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.887519:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.887528:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.887535:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888341:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f120a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888355:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f120a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888418:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f120a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302628.888435:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789302628.888559:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888568:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888576:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888584:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.888589:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888609:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888625:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302628.888629:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.888634:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888641:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12096 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888662:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888668:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888673:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888678:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.888681:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888687:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888694:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039400) 00010000:00010000:3.0:1789302628.888697:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302628.888700:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888716:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1209d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.888995:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f1208f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38cf expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.889014:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f120a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38cf expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.889021:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.889023:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302628.889026:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302628.889124:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+32:11505:x1876219484251008:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2081us (2594us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789302628.889133:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 164 00000100:00100000:2.0:1789302628.891987:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302628.892118:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484251136 00000100:00100000:3.0:1789302628.892131:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484251136 00000100:00100000:3.0:1789302628.892216:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 165 00000100:00100000:3.0:1789302628.892230:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+32:11505:x1876219484251136:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:3.0:1789302628.892339:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892360:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892385:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892440:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892448:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892456:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892462:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302628.892467:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892475:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892489:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302628.892492:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302628.892498:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302628.892504:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302628.892583:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+32:11505:x1876219484251136:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 356us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302628.892591:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 165 00000100:00100000:2.0:1789302628.894688:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302628.894842:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484251264 00000100:00100000:0.0:1789302628.894853:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484251264 00000100:00100000:0.0:1789302628.894945:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:0.0:1789302628.894957:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+32:2352:x1876219484251264:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302628.894976:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302628.895005:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f120a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38cf expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302628.895032:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:0.0:1789302628.895038:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302628.895097:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+31:2352:x1876219484251264:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 142us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302628.895104:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789302628.899986:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302628.900127:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484251520 00000100:00100000:0.0:1789302628.900141:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484251520 00000100:00100000:0.0:1789302628.900219:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:0.0:1789302628.900230:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+31:11505:x1876219484251520:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789302628.901246:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+32:11505:x1876219484251520:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 1010us (1269us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789302628.901258:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:2.0:1789302629.058444:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302629.058558:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484251776 00000100:00100000:3.0:1789302629.058572:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484251776 00000100:00100000:3.0:1789302629.058651:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00100000:3.0:1789302629.058683:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+32:11523:x1876219484251776:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1789302629.058717:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302629.058746:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38d6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.058921:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.058939:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.058955:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302629.058968:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789302629.059141:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38d6 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.059168:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38d6 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.059178:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302629.059182:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789302629.059187:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7a00, rc 0) 00000100:00100000:3.0:1789302629.059265:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+34:11523:x1876219484251776:12345-192.168.203.42@tcp:101:cat.0 Request processed in 586us (837us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789302629.059273:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00100000:2.0:1789302629.095425:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302629.099029:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484251904 00000100:00100000:3.0:1789302629.099054:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484251904 00000100:00100000:3.0:1789302629.099265:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 167 00000100:00100000:3.0:1789302629.099280:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+34:11524:x1876219484251904:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302629.099349:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302629.099377:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.099478:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f120d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.099496:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f120d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.099513:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f120d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302629.099567:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789302629.099571:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302629.099597:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f120d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.099631:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f120ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38dd expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.099676:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f120d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38dd expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.099687:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302629.099690:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302629.099695:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6200, rc 0) 00000100:00100000:3.0:1789302629.099800:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+35:11524:x1876219484251904:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 524us (4391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302629.099820:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 167 00000100:00100000:2.0:1789302629.111010:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302629.111859:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484252288 00000100:00100000:1.0:1789302629.111939:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484252288 00000100:00100000:1.0:1789302629.112078:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:1.0:1789302629.112091:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+35:11524:x1876219484252288:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302629.112575:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+36:11524:x1876219484252288:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 484us (1579us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789302629.112584:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:2.0:1789302629.118471:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302629.118640:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484252416 00000100:00100000:3.0:1789302629.118653:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484252416 00000100:00100000:3.0:1789302629.118753:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789302629.118766:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+36:11524:x1876219484252416:12345-192.168.203.42@tcp:103:lfs.0 00010000:00010000:3.0:1789302629.118790:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789302629.118835:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38c1 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.118870:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38d6 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.118885:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f11f69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3882 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.118896:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6907c68200) 00010000:00010000:3.0:1789302629.118909:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302629.118976:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+33:11524:x1876219484252416:12345-192.168.203.42@tcp:103:lfs.0 Request processed in 212us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302629.118985:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:2.0:1789302629.126468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302629.126572:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484252544 00000100:00100000:0.0:1789302629.126585:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484252544 00000100:00100000:0.0:1789302629.126810:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 168 00000100:00100000:0.0:1789302629.126823:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+33:11524:x1876219484252544:12345-192.168.203.42@tcp:58:lfs.0 00010000:00010000:0.0:1789302629.126975:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.126996:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.127011:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302629.128638:0:9859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789302629.129649:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+33:11524:x1876219484252544:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 2817us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302629.130526:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 168 00000100:00100000:2.0:1789302629.155895:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302629.156055:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484252672 00000100:00100000:0.0:1789302629.156070:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484252672 00000100:00100000:0.0:1789302629.156149:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 169 00000100:00100000:0.0:1789302629.156161:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+33:11526:x1876219484252672:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302629.156191:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302629.156221:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f120e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38e4 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.156379:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.156397:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.156418:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.156436:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.156443:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.156450:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158077:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158096:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158108:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302629.158159:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789302629.158164:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302629.158187:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158200:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158209:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158227:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158234:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158240:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302629.158245:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158252:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158265:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:0.0:1789302629.158268:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302629.158274:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158280:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f120ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158318:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158323:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158329:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158334:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302629.158352:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158359:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158368:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a69061a7f00) 00010000:00010000:0.0:1789302629.158371:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302629.158374:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158381:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f120f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158428:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f120e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 35 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158445:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 34 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.158453:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:0.0:1789302629.158456:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302629.158458:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045000, rc 0) 00000100:00100000:0.0:1789302629.158555:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+34:11526:x1876219484252672:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 2394us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302629.158564:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 169 00010000:00010000:0.0:1789302629.454010:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302629.774452:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505220608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302629.774524:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302629.774654:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505220608 00000100:00100000:2.0:1789302629.774662:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505220608 00000100:00100000:2.0:1789302629.774736:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789302629.774746:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505220608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302629.774781:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302629.774837:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505220608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302629.774852:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789302629.774886:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302629.775260:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505220608:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789302629.965548:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302629.965557:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302629.965983:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789302629.965998:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302629.966131:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c36d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505220736:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789302629.966247:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302629.971507:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c36d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505220736:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789302629.972528:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302629.972600:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484252800 00000100:00100000:3.0:1789302629.972608:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484252800 00000100:00100000:3.0:1789302629.972676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:3.0:1789302629.972685:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+34:11537:x1876219484252800:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789302629.972716:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789302629.972831:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+34:11537:x1876219484252800:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 146us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302629.972839:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:2.0:1789302629.980656:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302629.980750:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484252928 00000100:00100000:3.0:1789302629.980760:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484252928 00000100:00100000:3.0:1789302629.980830:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:3.0:1789302629.980840:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+34:11537:x1876219484252928:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789302629.980911:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.980928:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.980941:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983509:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983535:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983547:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983587:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983612:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983619:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302629.983667:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789302629.983672:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302629.983686:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983699:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983705:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983712:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983727:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302629.983731:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983740:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983751:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:3.0:1789302629.983754:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302629.983759:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983776:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f120ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983790:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983796:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983802:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983807:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302629.983810:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983816:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983833:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9a6904039a00) 00010000:00010000:3.0:1789302629.983836:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302629.983839:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983845:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12106 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983858:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983866:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983879:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983885:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302629.983889:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983896:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983904:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:3.0:1789302629.983907:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302629.983910:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302629.983915:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1210d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302629.984016:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+34:11537:x1876219484252928:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 3172us (3364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302629.984027:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:2.0:1789302629.992103:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302629.996777:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484253184 00000100:00100000:0.0:1789302629.996801:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484253184 00000100:00100000:0.0:1789302629.996880:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 172 00000100:00100000:0.0:1789302629.996890:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+34:11537:x1876219484253184:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302629.996910:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302629.996931:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12114 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38eb expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997035:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997051:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997062:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302629.997073:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789302629.997168:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997176:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997182:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997201:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302629.997205:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997213:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997224:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:0.0:1789302629.997227:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302629.997233:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997239:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1211b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997279:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12114 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38eb expref: 36 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997313:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:0.0:1789302629.997315:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302629.997319:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12114 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38eb expref: 36 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302629.997329:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045200, rc 0) 00000100:00100000:0.0:1789302629.997396:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+35:11537:x1876219484253184:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 508us (5304us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1789302629.997403:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 172 00000100:00100000:2.0:1789302630.008276:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.008419:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484253312 00000100:00100000:3.0:1789302630.008429:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484253312 00000100:00100000:3.0:1789302630.008501:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 173 00000100:00100000:3.0:1789302630.008511:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+35:11537:x1876219484253312:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789302630.008546:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789302630.008649:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693621a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+35:11537:x1876219484253312:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 140us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302630.008674:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 173 00000100:00080000:2.0:1789302630.008764:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302630.031197:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.033152:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484253568 00000100:00100000:3.0:1789302630.033169:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484253568 00000100:00100000:3.0:1789302630.033245:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 174 00000100:00100000:3.0:1789302630.033256:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+35:11537:x1876219484253568:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302630.033277:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302630.033280:0:9859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302630.033346:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f120d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38dd expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.033371:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302630.033376:0:9859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302630.033389:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f12129 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38f2 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302630.034692:0:9859:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789302630.034983:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12130 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.035000:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.035012:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12130 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.035071:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f12129 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f2 expref: 37 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.035090:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12130 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f2 expref: 36 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.036982:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6907c68400) 00010000:00010000:2.0:1789302630.036986:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302630.036990:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9400, rc 0) 00000100:00100000:2.0:1789302630.037550:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+36:11537:x1876219484253568:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 4289us (6358us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789302630.037559:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 174 00000100:00100000:2.0:1789302630.057010:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302630.058557:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484253824 00000100:00100000:0.0:1789302630.058569:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484253824 00000100:00100000:0.0:1789302630.058624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 175 00000100:00100000:0.0:1789302630.058633:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+36:11537:x1876219484253824:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789302630.058687:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302630.058713:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f12130 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f2 expref: 36 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.058732:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6907c68400) 00010000:00010000:0.0:1789302630.058743:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302630.058765:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.058778:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.058787:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.058801:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.058807:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.058813:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059024:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059041:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059049:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059055:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302630.059059:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059067:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059076:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:0.0:1789302630.059079:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302630.059083:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059089:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f1213e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059098:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059104:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059109:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059115:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302630.059121:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059127:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059134:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x23b5b6e7 (ffff9a69061a7f00) 00010000:00010000:0.0:1789302630.059136:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302630.059138:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.059144:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12145 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x23b5b6e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302630.059220:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+35:11537:x1876219484253824:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 587us (2218us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302630.059226:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 175 00000100:00100000:0.0:1789302630.066009:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302630.066046:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484253952 00000100:00100000:0.0:1789302630.066057:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484253952 00000100:00100000:0.0:1789302630.066105:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 176 00000100:00100000:0.0:1789302630.066114:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+35:11537:x1876219484253952:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302630.066134:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302630.066158:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1214c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b38f9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.066211:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.066225:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.066244:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.066352:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f1214c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.066370:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.066378:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:0.0:1789302630.066382:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789302630.066385:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045200, rc 0) 00000100:00100000:0.0:1789302630.066446:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+36:11537:x1876219484253952:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 332us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302630.066453:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 176 00000100:00100000:0.0:1789302630.070085:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302630.070137:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484254208 00000100:00100000:0.0:1789302630.070146:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484254208 00000100:00100000:0.0:1789302630.070193:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 177 00000100:00100000:0.0:1789302630.070203:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+36:11537:x1876219484254208:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789302630.070300:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.070317:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.070328:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302630.070661:0:9859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789302630.070672:0:9859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341256385847ns, next at 342256383725ns, rc = 0 00000004:00010000:0.0:1789302630.070760:0:9859:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008110365f reply state 0000000066d405e7 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302630.070770:0:9859:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302630.070877:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+38:11537:x1876219484254208:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 675us (800us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789302630.070885:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 177 00010000:00010000:1.0:1789302630.080586:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.080607:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.080617:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.080624:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302630.080630:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.080639:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.080658:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:1.0:1789302630.080661:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789302630.080666:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.080674:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f1215a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.081740:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.081975:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484254336 00000100:00100000:3.0:1789302630.081985:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484254336 00000100:00100000:3.0:1789302630.082044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 178 00000100:00100000:3.0:1789302630.082055:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+37:11537:x1876219484254336:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302630.082079:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302630.082099:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.082157:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.082188:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.082209:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:3.0:1789302630.082212:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789302630.082215:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6200, rc 0) 00000100:00100000:3.0:1789302630.082268:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+38:11537:x1876219484254336:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 215us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302630.082276:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 178 00000100:00100000:2.0:1789302630.090143:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302630.090222:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484254464 00000100:00100000:1.0:1789302630.090232:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484254464 00000100:00100000:1.0:1789302630.090333:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:1.0:1789302630.090344:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484254464:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789302630.090677:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484254464:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 335us (540us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789302630.090685:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00080000:2.0:1789302630.090847:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302630.094189:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302630.094270:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484254720 00000100:00100000:2.0:1789302630.094280:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484254720 00000100:00100000:2.0:1789302630.094365:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:2.0:1789302630.094376:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+38:11537:x1876219484254720:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789302630.094614:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+39:11537:x1876219484254720:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 238us (431us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789302630.094622:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:0.0:1789302630.103187:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302630.103603:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484254976 00000100:00100000:1.0:1789302630.103614:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484254976 00000100:00100000:1.0:1789302630.103672:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 179 00000100:00100000:1.0:1789302630.103682:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+39:11537:x1876219484254976:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789302630.103803:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+39:11537:x1876219484254976:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 121us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302630.103811:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 179 00000100:00100000:0.0:1789302630.109695:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302630.109832:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484255104 00000100:00100000:1.0:1789302630.109843:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484255104 00000100:00100000:1.0:1789302630.109918:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 180 00000100:00100000:1.0:1789302630.109930:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+39:11537:x1876219484255104:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302630.109952:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302630.109972:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aac00/0x20be524657f12168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3907 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.110035:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f1216f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.110066:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f1216f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.110080:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f1216f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302630.110118:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302630.110137:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f1216f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.110163:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aac00/0x20be524657f12168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3907 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.110180:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f1216f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3907 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.110188:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:1.0:1789302630.110191:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789302630.110194:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361ab200, rc 0) 00000100:00100000:1.0:1789302630.110253:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+40:11537:x1876219484255104:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 326us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302630.110260:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 180 00000100:00100000:3.0:1789302630.114501:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302630.114622:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484255232 00000100:00100000:1.0:1789302630.114633:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484255232 00000100:00100000:1.0:1789302630.114692:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:1.0:1789302630.114702:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484255232:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302630.114727:0:10693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302630.114762:0:10693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b390e expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302630.114790:0:10693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa69765, blocks: 0x1 00010000:00010000:1.0:1789302630.114810:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1789302630.114815:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302630.114834:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 8 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.114851:0:10693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 8 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.114863:0:10693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aa400, rc 0) 00000100:00100000:1.0:1789302630.114937:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484255232:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 236us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302630.114945:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:1.0:1789302630.121964:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302630.122032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484255488 00000100:00100000:2.0:1789302630.122043:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484255488 00000100:00100000:2.0:1789302630.122137:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 181 00000100:00100000:2.0:1789302630.122148:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+40:11537:x1876219484255488:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789302630.122257:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+40:11537:x1876219484255488:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 111us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302630.122264:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 181 00000100:00100000:0.0:1789302630.125378:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302630.125452:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484255616 00000100:00100000:1.0:1789302630.125461:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484255616 00000100:00100000:1.0:1789302630.125516:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:1.0:1789302630.125526:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+8:11537:x1876219484255616:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302630.125546:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302630.125564:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3915 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.125594:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 9 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.125617:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302630.125622:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302630.125628:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.125662:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 9 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.125677:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 9 pid: 10693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302630.125692:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1876219505220864:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302630.125836:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6935fbc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302630.138220:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.138365:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484255744 00000100:00100000:3.0:1789302630.138378:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484255744 00010000:00010000:3.0:1789302630.138426:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 10 pid: 10693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302630.138467:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:3.0:1789302630.138476:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+10:2352:x1876219484255744:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302630.138489:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302630.138515:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 10 pid: 10693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.138530:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 10 pid: 10693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.138568:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302630.138573:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302630.138583:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.138593:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.138633:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302630.138649:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fdd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1876219505220992:192.168.203.42@tcp:105: 00000100:00100000:3.0:1789302630.138735:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13b40 going to sleep for 11 seconds 00010000:00010000:2.0:1789302630.138910:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019cca2e5/0x20be524657f12176 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b390e expref: 10 pid: 10693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.138923:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1876219505220864:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302630.138946:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.138984:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aa600, rc 0) 00000100:00100000:2.0:1789302630.139023:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:11537:x1876219484255616:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 13498us (13653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302630.139030:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:3.0:1789302630.141784:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fdd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1876219505220992:192.168.203.42@tcp:105: 00010000:00010000:3.0:1789302630.141810:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302630.141873:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484255744:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 3398us (3663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302630.141883:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:2.0:1789302630.150535:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.150601:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484255872 00000100:00100000:3.0:1789302630.150611:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484255872 00002000:00100000:3.0:1789302630.150659:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a6936218000 x1876219484255872/t0(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:206/0 lens 504/0 e 0 to 0 dl 1789302641 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789302630.150670:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936218000 with x1876219484255872 ext(0->8) 00002000:00010000:3.0:1789302630.150686:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6936218000 00000100:00100000:3.0:1789302630.150742:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:3.0:1789302630.150752:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484255872:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789302630.151200:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ace2f696-3715-4928-b36c-02db3411d1a3+10:2352:x1876219484255872:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 Request processed in 446us (672us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789302630.151208:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00002000:00100000:3.0:1789302630.151215:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a6936218000 x1876219484255872/t4294967314(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:206/0 lens 504/448 e 0 to 0 dl 1789302641 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789302630.151223:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936218000 with x1876219484255872 ext(0->8) 00002000:00010000:3.0:1789302630.151226:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6936218000 00000100:00100000:3.0:1789302630.155850:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302630.156169:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484256000 00000100:00100000:0.0:1789302630.156179:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484256000 00000100:00100000:0.0:1789302630.156236:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 182 00000100:00100000:0.0:1789302630.156246:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+40:11537:x1876219484256000:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789302630.208106:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1789302630.208121:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789302630.208160:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1789302630.208175:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000100:00100000:0.0:1789302630.209097:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+18:11537:x1876219484256000:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 52845us (53251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302630.209108:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 182 00000100:00100000:2.0:1789302630.209446:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505221120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789302630.209502:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302630.209565:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505221120 00000100:00100000:2.0:1789302630.209573:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505221120 00000100:00100000:2.0:1789302630.209624:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789302630.209633:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505221120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789302630.209800:0:10693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789302630.209805:0:10693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789302629 00000020:00080000:1.0:1789302630.210329:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789302630.210344:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00002000:00010000:2.0:1789302630.211106:0:10693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789302630.211109:0:10693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789302629 -> 1789302629 00002000:00010000:2.0:1789302630.211112:0:10693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789302630.211183:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876219505221120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1549us (1679us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789302630.211193:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789302630.211224:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789302630.211329:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6936219880/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789302630.211336:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505221120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789302630.217265:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.217382:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484256128 00000100:00100000:3.0:1789302630.217393:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484256128 00000100:00100000:3.0:1789302630.217450:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:3.0:1789302630.217460:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+10:2352:x1876219484256128:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000040:00080000:1.0:1789302630.244170:0:12521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302630.244180:0:12521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302630.244220:0:12521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789302630.244228:0:12521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789302630.287018:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505221632:0@lo:400:kworker.0 00000100:00100000:1.0:1789302630.287086:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302630.287175:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302630.287182:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505221504:0@lo:400:kworker.0 00000100:00100000:1.0:1789302630.287209:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302630.287242:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505221504 00000100:00100000:1.0:1789302630.287249:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505221504 00000100:00100000:1.0:1789302630.287323:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789302630.287332:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505221504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302630.287381:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505221504:12345-0@lo:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302630.287389:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789302630.287432:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505221504:0@lo:400:kworker.0 00000100:00100000:0.0:1789302630.287773:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505221632 00000100:00100000:0.0:1789302630.287778:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505221632 00000100:00100000:0.0:1789302630.287814:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789302630.287831:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876219505221632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302630.287881:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1876219505221632:12345-0@lo:400:kworker.0 Request processed in 52us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302630.287899:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789302630.288023:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505221632:0@lo:400:kworker.0 00000100:00100000:2.0:1789302630.288129:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505221248:0@lo:400:kworker.0 00000100:00100000:2.0:1789302630.288170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302630.288239:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505221760:0@lo:400:kworker.0 00000100:00100000:2.0:1789302630.288265:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302630.288306:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789302630.288313:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505221376:0@lo:400:kworker.0 00000100:00100000:2.0:1789302630.288334:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302630.288354:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505221888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302630.288374:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789302630.288403:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302630.288415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505221760 00000100:00100000:2.0:1789302630.288419:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505221760 00000100:00100000:2.0:1789302630.288450:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505221376 00000100:00100000:2.0:1789302630.288452:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505221376 00000100:00100000:2.0:1789302630.288471:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789302630.288477:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505221760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302630.288512:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505221760:12345-0@lo:400:kworker.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302630.288519:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789302630.288534:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789302630.288539:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505221376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302630.288567:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505221376:12345-0@lo:400:kworker.0 Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302630.288572:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789302630.288592:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505221888 00000100:00100000:2.0:1789302630.288596:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505221888 00000100:00100000:2.0:1789302630.288617:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302630.288622:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876219505221888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302630.288645:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302630.288677:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876219505221888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302630.288682:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1789302630.288696:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302630.288717:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505221376:0@lo:400:kworker.0 00000100:00100000:2.0:1789302630.288733:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505221888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789302630.288742:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505221760:0@lo:400:kworker.0 00000100:00100000:1.0:1789302630.294095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505221248 00000100:00100000:1.0:1789302630.294111:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505221248 00000100:00100000:1.0:1789302630.294163:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789302630.294172:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505221248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302630.294259:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3305:x1876219505221248:12345-0@lo:400:kworker.0 Request processed in 89us (6089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302630.294266:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789302630.294552:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+10:2352:x1876219484256128:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 77090us (77294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302630.294561:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000001:00080000:3.0:1789302630.294588:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789302630.294599:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1789302630.294606:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1789302630.295767:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505221248:0@lo:400:kworker.0 00000100:00100000:3.0:1789302630.300006:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302630.300784:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484256384 00000100:00100000:1.0:1789302630.300795:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484256384 00000100:00100000:1.0:1789302630.300862:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 183 00000100:00100000:1.0:1789302630.300874:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+18:11537:x1876219484256384:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302630.301356:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302630.301384:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f1216f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3907 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.301418:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:1.0:1789302630.301423:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302630.301456:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.301469:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.301480:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302630.301773:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000585532db reply state 00000000aaf100f8 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302630.301783:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302630.301899:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+19:11537:x1876219484256384:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 1027us (1901us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789302630.301907:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 183 00010000:00010000:2.0:1789302630.306874:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.306891:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.306898:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.306904:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aaa00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302630.306908:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.306915:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.306931:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:2.0:1789302630.306934:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302630.306938:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.306955:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12184 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302630.317456:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.317626:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484256512 00000100:00100000:3.0:1789302630.317636:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484256512 00000100:00100000:3.0:1789302630.317702:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:3.0:1789302630.317721:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484256512:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789302630.318012:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789302630.318016:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789302629 -> 1789302627 00002000:00010000:3.0:1789302630.318019:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789302626 00002000:00010000:3.0:1789302630.318021:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789302629 -> 1789302627 00002000:00010000:3.0:1789302630.318023:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789302630.318084:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484256512:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 365us (636us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789302630.318092:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:0.0:1789302630.329244:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302630.338984:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484256768 00000100:00100000:2.0:1789302630.338997:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484256768 00000100:00100000:2.0:1789302630.339065:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 184 00000100:00100000:2.0:1789302630.339075:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+18:11537:x1876219484256768:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789302630.339145:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.339165:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.339175:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.339209:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.339222:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 18 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.339236:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505222016:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302630.339601:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906150900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302630.347926:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505222016:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302630.347959:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302630.350935:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.351369:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484256896 00000100:00100000:3.0:1789302630.351379:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484256896 00010000:00010000:3.0:1789302630.351418:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 19 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302630.351460:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789302630.351469:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+19:2351:x1876219484256896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302630.351484:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302630.351490:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 19 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.351503:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 19 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.351526:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38f9 expref: 19 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.351539:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:3.0:1789302630.351551:0:6712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.351562:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.351569:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302630.351602:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302630.351657:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302630.351659:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+18:2351:x1876219484256896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 191us (734us total) trans 0 rc 0/0 00010000:00010000:2.0:1789302630.351666:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302630.351668:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00010000:00010000:2.0:1789302630.351694:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.351701:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.351708:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.351723:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302630.351727:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.351734:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.351743:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:2.0:1789302630.351746:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789302630.351750:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.351756:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f1218b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.351798:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+17:11537:x1876219484256768:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 Request processed in 12724us (22562us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789302630.351813:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 184 00000100:00100000:3.0:1789302630.354033:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302630.354116:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484257024 00000100:00100000:2.0:1789302630.354128:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484257024 00000100:00100000:2.0:1789302630.354183:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789302630.354194:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484257024:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789302630.354239:0:10693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.354260:0:10693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.354268:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302630.354271:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302630.354276:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.354339:0:10693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.354354:0:10693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 8 pid: 6697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.354368:0:10693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10693:1876219505222144:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302630.354451:0:10693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906150900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302630.358207:0:10693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10693:1876219505222144:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302630.358249:0:10693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302630.361192:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302630.361268:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484257152 00000100:00100000:1.0:1789302630.361277:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484257152 00010000:00010000:1.0:1789302630.361357:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 9 pid: 6697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302630.361393:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:1.0:1789302630.361404:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484257152:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302630.361419:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302630.361442:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 9 pid: 6697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.361473:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 9 pid: 6697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.361496:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9411c2c/0x20be524657f1217d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3915 expref: 9 pid: 6697 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.361512:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302630.361516:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302630.361521:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.361531:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.361557:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302630.361609:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484257152:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 206us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302630.361617:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00010000:00010000:0.0:1789302630.361836:0:10693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.361846:0:10693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.361872:0:10693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.361880:0:10693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.361888:0:10693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.361894:0:10693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302630.361899:0:10693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.361906:0:10693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.361931:0:10693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.361938:0:10693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7c6710/0x20be524657f12192 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302630.361995:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484257024:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 7803us (7970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302630.362002:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:3.0:1789302630.374745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302630.374825:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484257408 00000100:00100000:1.0:1789302630.374836:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484257408 00000100:00100000:1.0:1789302630.374905:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 185 00000100:00100000:1.0:1789302630.374915:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+17:11537:x1876219484257408:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789302630.374992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.375009:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.375031:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.375239:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.375251:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.375260:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.375323:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.375338:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 18 pid: 5846 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302630.375352:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903461180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505222272:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302630.375431:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9180 going to sleep for 11 seconds 00000100:00100000:3.0:1789302630.382698:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302630.382753:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903461180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505222272:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302630.382779:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.383353:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484257536 00000100:00100000:2.0:1789302630.383362:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484257536 00010000:00010000:2.0:1789302630.383400:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 19 pid: 5846 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.383434:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:2.0:1789302630.383443:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+19:2352:x1876219484257536:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302630.383458:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302630.383464:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 19 pid: 5846 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.383476:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 19 pid: 5846 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.383497:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3900 expref: 19 pid: 5846 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.383512:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:2.0:1789302630.383517:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.383526:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.383533:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.383570:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302630.383622:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+18:2352:x1876219484257536:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 180us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302630.383629:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00010000:00010000:2.0:1789302630.383747:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.383755:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302630.383958:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789302630.384111:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789302630.384156:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789302630.384232:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876219505222400:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789302630.384281:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302630.384332:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906150c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302630.384632:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505222400 00000100:00100000:3.0:1789302630.384639:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505222400 00000100:00100000:3.0:1789302630.384681:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789302630.384689:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876219505222400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789302630.384779:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876219505222400:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302630.384786:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789302630.386321:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789302630.386332:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6936219880, transno 4294967315 00000100:00100000:2.0:1789302630.386352:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876219505222400:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789302630.387961:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789302630.388065:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e37480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876219505222528:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789302630.388128:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302630.388163:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906150900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302630.389186:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505222528 00000100:00100000:1.0:1789302630.389198:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505222528 00000100:00100000:1.0:1789302630.389243:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302630.389253:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876219505222528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789302630.389874:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876219505222528:12345-0@lo:1000:mdt00_001.0 Request processed in 463us (1585us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789302630.389884:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789302630.391017:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e37480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5846:1876219505222528:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789302630.391068:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391094:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391102:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391108:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361abe00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302630.391112:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391120:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391135:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7b00) 00010000:00010000:2.0:1789302630.391138:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302630.391144:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391150:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abe00/0x20be524657f121a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391179:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391185:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391191:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391196:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302630.391204:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391210:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391218:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:2.0:1789302630.391221:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302630.391223:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391228:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f120dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391250:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391264:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 21 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.391273:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.391365:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 21 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.391384:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 21 pid: 6295 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302630.391399:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6903e36300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505222656:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302630.391486:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906150900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302630.398434:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6903e36300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1876219505222656:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302630.398466:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.399913:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302630.404568:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484257664 00000100:00100000:0.0:1789302630.404583:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484257664 00010000:00010000:2.0:1789302630.408376:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 22 pid: 6295 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302630.408434:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:2.0:1789302630.408444:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+22:2352:x1876219484257664:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302630.408459:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302630.408466:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 22 pid: 6295 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.408478:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 22 pid: 6295 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.408497:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f120f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b38e4 expref: 22 pid: 6295 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.408510:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:2.0:1789302630.408516:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.408525:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.408533:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.408557:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302630.408615:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+21:2352:x1876219484257664:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 173us (8708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302630.408623:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 72 00010000:00010000:1.0:1789302630.408958:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.408967:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.408980:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.408986:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.408993:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.408999:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302630.409004:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409011:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409020:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:1.0:1789302630.409031:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302630.409036:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409041:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f121a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409053:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409058:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409064:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409069:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aaa00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302630.409071:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409077:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409085:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69061a7100) 00010000:00010000:1.0:1789302630.409087:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302630.409090:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302630.409095:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aaa00/0x20be524657f12199 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302630.409333:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+20:11537:x1876219484257408:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 34419us (34596us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789302630.409350:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 185 00000020:00080000:1.0:1789302630.409355:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789302630.409545:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302630.409550:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302630.410044:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789302630.410052:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789302630.415237:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302630.415406:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484257920 00000100:00100000:0.0:1789302630.415418:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484257920 00000100:00100000:0.0:1789302630.415480:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:0.0:1789302630.415490:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6904985050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+20:11537:x1876219484257920:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789302630.416527:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789302630.416635:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:0.0:1789302630.416696:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.416712:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.416736:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.416745:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.416752:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.416758:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302630.416830:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789302630.416926:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6904985050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+22:11537:x1876219484257920:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 1435us (1695us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789302630.416934:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000020:00080000:0.0:1789302630.416939:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789302630.418988:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302630.418998:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.419008:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302630.419013:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.419022:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.419048:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a69061a7200) 00010000:00010000:2.0:1789302630.419051:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789302630.419059:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.419064:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f121ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302630.419223:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302630.419227:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302630.419229:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302630.478196:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789302630.879221:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1789302630.879244:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:0.0:1789302631.507997:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789302632.105271:0:12575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302632.105281:0:12575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789302632.105347:0:12575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789302632.105353:0:12575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789302632.279190:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302632.279228:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484258176 00000100:00100000:2.0:1789302632.279238:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484258176 00000100:00100000:2.0:1789302632.279315:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 186 00000100:00100000:2.0:1789302632.279333:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+22:11556:x1876219484258176:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302632.279358:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302632.279378:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f121b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b391c expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.279726:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f121bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.279741:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f121bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.279753:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f121bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302632.279765:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789302632.280094:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f121b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b391c expref: 25 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.280112:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f121bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b391c expref: 24 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.280119:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:2.0:1789302632.280122:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789302632.280126:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9000, rc 0) 00000100:00100000:2.0:1789302632.280192:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+24:11556:x1876219484258176:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 860us (1011us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789302632.280200:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 186 00000100:00080000:2.0:1789302632.280230:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302632.296437:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302632.297554:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484258304 00000100:00100000:1.0:1789302632.297565:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484258304 00000100:00100000:1.0:1789302632.297624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 187 00000100:00100000:1.0:1789302632.297634:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+24:11556:x1876219484258304:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:1.0:1789302632.297703:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.297720:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.297732:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.297746:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.297753:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.297760:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298009:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298016:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298022:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302632.298068:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298080:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298086:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298094:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298100:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aba00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.298103:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298110:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298120:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:1.0:1789302632.298123:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302632.298127:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298133:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298143:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298149:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298160:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298165:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.298168:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298173:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298180:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a69051af300) 00010000:00010000:1.0:1789302632.298182:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302632.298184:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298190:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298202:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298208:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298213:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298218:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aae00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.298221:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298234:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298241:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af200) 00010000:00010000:1.0:1789302632.298243:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302632.298246:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.298251:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302632.298343:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+24:11556:x1876219484258304:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 711us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302632.298351:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 187 00000100:00100000:0.0:1789302632.384503:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302632.384819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484258560 00000100:00100000:1.0:1789302632.384829:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484258560 00000100:00100000:1.0:1789302632.384892:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 188 00000100:00100000:1.0:1789302632.384904:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+24:11559:x1876219484258560:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302632.384927:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302632.384949:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3923 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385024:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385038:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385050:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385081:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385089:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385097:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385411:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385421:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385429:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302632.385440:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789302632.385533:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385542:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385549:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385556:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.385561:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385578:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385590:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:1.0:1789302632.385669:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302632.385676:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385683:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f121e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385697:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385703:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385708:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385712:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aba00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.385715:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385721:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385728:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a69051af200) 00010000:00010000:1.0:1789302632.385731:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302632.385734:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385750:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f121ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385791:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f121df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385814:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.385821:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:1.0:1789302632.385824:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302632.385826:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aa200, rc 0) 00000100:00100000:1.0:1789302632.385884:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+26:11559:x1876219484258560:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 981us (1389us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789302632.385892:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 188 00000100:00100000:2.0:1789302632.402119:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302632.402621:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484258688 00000100:00100000:3.0:1789302632.402631:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484258688 00000100:00100000:3.0:1789302632.402695:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 189 00000100:00100000:3.0:1789302632.402705:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+26:11559:x1876219484258688:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:3.0:1789302632.402764:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402781:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402794:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402830:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402839:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402847:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402853:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302632.402858:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402865:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402877:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:3.0:1789302632.402881:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789302632.402885:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.402902:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302632.402975:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+26:11559:x1876219484258688:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 271us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302632.402984:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 189 00000100:00100000:0.0:1789302632.405882:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302632.406006:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484258944 00000100:00100000:3.0:1789302632.406016:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484258944 00000100:00100000:3.0:1789302632.406071:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:3.0:1789302632.406080:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+26:11559:x1876219484258944:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789302632.406452:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+27:11559:x1876219484258944:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 372us (577us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789302632.406461:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:0.0:1789302632.462814:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302632.463019:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484259200 00000100:00100000:2.0:1789302632.463030:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484259200 00000100:00100000:2.0:1789302632.463093:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 190 00000100:00100000:2.0:1789302632.463104:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+27:11085:x1876219484259200:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302632.463129:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302632.463161:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12209 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b392a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.463261:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.463276:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.463323:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.463360:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.463374:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 28 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302632.463387:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505222784:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302632.463471:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906186900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302632.479197:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302632.479317:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484259328 00000100:00100000:0.0:1789302632.479326:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484259328 00010000:00010000:0.0:1789302632.479367:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 29 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302632.479410:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:0.0:1789302632.479434:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+29:2351:x1876219484259328:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302632.479449:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302632.479456:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 29 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.479468:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 29 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.479489:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:0.0:1789302632.479494:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.479503:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.479511:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.479529:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302632.479581:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+29:2351:x1876219484259328:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 148us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302632.479588:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 73 00010000:00010000:3.0:1789302632.480585:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f121f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3923 expref: 28 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302632.480617:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1876219505222784:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302632.480640:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.480649:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.480654:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302632.480673:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789302632.481071:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12209 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.481088:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.481097:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:3.0:1789302632.481100:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302632.481103:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8c00, rc 0) 00000100:00100000:3.0:1789302632.481154:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+28:11085:x1876219484259200:12345-192.168.203.42@tcp:101:bash.0 Request processed in 18052us (18360us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789302632.481163:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 190 00000100:00100000:2.0:1789302632.496865:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302632.497222:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484259584 00000100:00100000:1.0:1789302632.497233:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484259584 00000100:00100000:1.0:1789302632.497313:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 191 00000100:00100000:1.0:1789302632.497324:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+28:11085:x1876219484259584:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:1.0:1789302632.497590:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.497608:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.497620:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302632.497692:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1789302632.497729:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004323d5a2 reply state 00000000a9a0a708 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302632.497739:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789302632.497784:0:6295:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1789302632.497910:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+32:11085:x1876219484259584:12345-192.168.203.42@tcp:36:bash.0 Request processed in 587us (1052us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789302632.497919:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 191 00000020:00080000:1.0:1789302632.497924:0:6295:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789302632.501115:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.501132:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.501139:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.501145:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aba00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.501150:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.501157:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.501173:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:1.0:1789302632.501176:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302632.501181:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.501206:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f1221e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302632.501718:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302632.502546:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484259712 00000100:00100000:1.0:1789302632.502557:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484259712 00000100:00100000:1.0:1789302632.502790:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 192 00000100:00100000:1.0:1789302632.502813:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+31:11085:x1876219484259712:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302632.502838:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302632.502869:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f12225 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3931 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.502932:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f12225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3931 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.503025:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f12225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3931 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.503046:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:1.0:1789302632.503050:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302632.503053:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aa000, rc 0) 00000100:00100000:1.0:1789302632.505402:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+32:11085:x1876219484259712:12345-192.168.203.42@tcp:101:bash.0 Request processed in 901us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302632.505416:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 192 00000100:00100000:0.0:1789302632.511879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302632.512176:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484259840 00000100:00100000:3.0:1789302632.512185:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484259840 00000100:00080000:0.0:1789302632.512353:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302632.513464:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:3.0:1789302632.513482:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:11085:x1876219484259840:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789302632.513501:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302632.513522:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3938 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302632.513550:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa69763, atime: 0x6aa69762, ctime: 0x6aa69763, blocks: 0xb 00010000:00010000:3.0:1789302632.513574:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1789302632.513580:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302632.513587:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.513605:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.513629:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7a00, rc 0) 00000100:00100000:3.0:1789302632.513694:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+8:11085:x1876219484259840:12345-192.168.203.42@tcp:101:bash.0 Request processed in 219us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302632.513701:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:3.0:1789302632.519824:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302632.520061:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484259968 00000100:00100000:2.0:1789302632.520134:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484259968 00002000:00010000:3.0:1789302632.520230:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789302632.520234:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6935fded80 with x1876219484259968 ext(0->18446744073709551615) 00002000:00010000:3.0:1789302632.520245:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6935fded80. 00000100:00100000:3.0:1789302632.520331:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:3.0:1789302632.520341:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484259968:12345-192.168.203.42@tcp:10:bash.0 00002000:00010000:3.0:1789302632.520587:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789302632.520739:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789302627 -> 1789302631 00002000:00010000:3.0:1789302632.520742:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789302626 -> 1789302626 00002000:00010000:3.0:1789302632.520744:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789302627 -> 1789302631 00002000:00010000:3.0:1789302632.520747:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789302632.520796:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484259968:12345-192.168.203.42@tcp:10:bash.0 Request processed in 456us (981us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789302632.520814:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00002000:00010000:3.0:1789302632.520817:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789302632.520820:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6935fded80 with x1876219484259968 ext(0->18446744073709551615) 00002000:00010000:3.0:1789302632.520825:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6935fded80. 00010000:00010000:2.0:1789302632.525456:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302632.628254:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302632.628408:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484260096 00000100:00100000:3.0:1789302632.628418:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484260096 00000100:00100000:3.0:1789302632.628497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 193 00000100:00100000:3.0:1789302632.628507:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+32:11573:x1876219484260096:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:3.0:1789302632.628577:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628593:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628604:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628620:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628626:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628633:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628867:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628877:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628884:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302632.628933:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628945:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628957:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628964:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628971:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302632.628975:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628982:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.628994:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302632.628997:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302632.629001:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629006:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12233 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629022:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629028:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629033:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629038:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302632.629046:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629470:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629481:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039300) 00010000:00010000:3.0:1789302632.629484:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302632.629487:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629492:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1223a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629510:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629516:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629521:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629526:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302632.629529:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629534:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629541:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:3.0:1789302632.629543:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302632.629553:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.629560:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12241 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302632.629648:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+32:11573:x1876219484260096:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 1140us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302632.629656:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 193 00000100:00100000:0.0:1789302632.690493:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302632.690593:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484260352 00000100:00100000:3.0:1789302632.690603:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484260352 00000100:00100000:3.0:1789302632.690663:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 194 00000100:00100000:3.0:1789302632.690673:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+32:11576:x1876219484260352:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302632.690691:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302632.690721:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12248 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b393f expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.690789:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.690813:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.690826:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.690850:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.690859:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.690885:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691125:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1225d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691135:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691142:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1225d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302632.691151:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789302632.691248:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691257:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691265:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691272:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302632.691276:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691333:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691345:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302632.691348:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302632.691359:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691365:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f1224f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691381:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691388:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691393:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691398:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302632.691401:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691407:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691415:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039300) 00010000:00010000:3.0:1789302632.691417:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302632.691420:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691426:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691464:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12248 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b393f expref: 35 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691492:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1225d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b393f expref: 34 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.691500:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:3.0:1789302632.691502:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789302632.691505:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7200, rc 0) 00000100:00100000:3.0:1789302632.691566:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+34:11576:x1876219484260352:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 894us (1082us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789302632.691573:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 194 00000100:00100000:1.0:1789302632.705678:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302632.705838:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484260480 00000100:00100000:2.0:1789302632.705856:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484260480 00000100:00100000:2.0:1789302632.705911:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 195 00000100:00100000:2.0:1789302632.705922:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+34:11576:x1876219484260480:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:2.0:1789302632.705986:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.706004:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.706014:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.706049:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.706062:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 34 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302632.706075:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505222912:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302632.706180:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906186900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302632.712597:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302632.712839:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505222912:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302632.712867:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302632.713085:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484260736 00000100:00100000:0.0:1789302632.713094:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484260736 00000100:00100000:0.0:1789302632.713150:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:0.0:1789302632.713174:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+35:5590:x1876219484260736:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789302632.713724:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+36:5590:x1876219484260736:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 549us (1135us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789302632.713732:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:0.0:1789302632.716575:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302632.717417:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484260864 00000100:00100000:2.0:1789302632.717428:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484260864 00010000:00010000:2.0:1789302632.717482:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 36 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302632.717515:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 74 00000100:00100000:2.0:1789302632.717524:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+36:2352:x1876219484260864:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302632.717539:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302632.717546:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 36 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.717559:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 36 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.717579:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f12210 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b392a expref: 36 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.717595:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:2.0:1789302632.717600:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.717610:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.717618:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.720247:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302632.720360:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+35:2352:x1876219484260864:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 2831us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302632.720374:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 74 00010000:00010000:1.0:1789302632.720716:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.720739:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.720772:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.720779:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.720786:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.720792:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.720797:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.720813:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.720829:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:1.0:1789302632.720832:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302632.720836:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.720843:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9c00/0x20be524657f1226b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302632.720949:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+34:11576:x1876219484260480:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 15028us (15279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302632.720957:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 195 00000100:00100000:0.0:1789302632.736400:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302632.737442:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484261120 00000100:00100000:3.0:1789302632.737454:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484261120 00000100:00100000:3.0:1789302632.737513:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:3.0:1789302632.737525:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+34:11576:x1876219484261120:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:3.0:1789302632.737769:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+35:11576:x1876219484261120:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 246us (1379us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789302632.737777:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:0.0:1789302632.894610:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302632.894710:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484261376 00000100:00100000:3.0:1789302632.894720:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484261376 00000100:00100000:3.0:1789302632.894785:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 196 00000100:00100000:3.0:1789302632.894796:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+35:11587:x1876219484261376:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:3.0:1789302632.894832:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302632.894866:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3946 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.894936:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.894961:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.894974:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.894989:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.894996:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895003:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895251:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895260:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895267:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302632.895277:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789302632.895568:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895576:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895583:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895596:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302632.895601:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895608:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895621:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302632.895623:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302632.895629:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895634:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12279 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895651:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895656:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895661:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895665:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302632.895668:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895673:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895690:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039300) 00010000:00010000:3.0:1789302632.895692:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302632.895695:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895701:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12280 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3946 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895757:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3946 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302632.895764:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:3.0:1789302632.895766:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302632.895768:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302632.895917:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+37:11587:x1876219484261376:12345-192.168.203.42@tcp:101:cat.0 Request processed in 1121us (1314us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789302632.895925:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 196 00000100:00100000:1.0:1789302632.907852:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302632.911072:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484261632 00000100:00100000:0.0:1789302632.911086:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484261632 00000100:00100000:0.0:1789302632.911157:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:0.0:1789302632.911166:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+37:11587:x1876219484261632:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:0.0:1789302632.911452:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+38:11587:x1876219484261632:12345-192.168.203.42@tcp:35:cat.0 Request processed in 286us (3610us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789302632.911460:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:2.0:1789302632.949932:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302632.952451:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484261888 00000100:00100000:1.0:1789302632.952468:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484261888 00000100:00100000:1.0:1789302632.954389:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 197 00000100:00100000:1.0:1789302632.954413:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+38:11588:x1876219484261888:12345-192.168.203.42@tcp:36:rm.0 00010000:00010000:1.0:1789302632.954481:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789302632.954511:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3946 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954537:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1225d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b393f expref: 37 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954548:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f12225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3931 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954558:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051af300) 00010000:00010000:1.0:1789302632.954568:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302632.954591:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954605:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954614:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954629:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954636:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954658:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954932:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.954939:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302632.957154:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1789302632.957169:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344142881955ns, next at 345142878896ns, rc = 0 00010000:00010000:1.0:1789302632.961225:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961249:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961261:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961271:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961278:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961300:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961699:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302632.961724:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961730:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961735:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961741:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361ab400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.961745:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961751:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961762:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051aff00) 00010000:00010000:1.0:1789302632.961765:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789302632.961769:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961775:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961796:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961814:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961820:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961832:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361ab600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302632.961835:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961840:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961849:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:1.0:1789302632.961851:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302632.961854:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302632.961860:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f12295 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302632.961870:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a98945c reply state 0000000059b1f6a6 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302632.961879:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302632.961986:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+37:11588:x1876219484261888:12345-192.168.203.42@tcp:36:rm.0 Request processed in 7578us (12059us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789302632.961995:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 197 00010000:00010000:0.0:1789302632.962256:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302632.962263:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.962269:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302632.962273:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.962279:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.962323:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a69051aff00) 00010000:00010000:0.0:1789302632.962326:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789302632.962337:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.962343:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f122aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302632.962362:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302632.962364:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302632.962366:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302632.964773:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.964788:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.964796:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.964811:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361ab000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302632.964816:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.964824:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.964839:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a69051af200) 00010000:00010000:2.0:1789302632.964842:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302632.964847:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302632.964854:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1229c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.021908:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302633.022056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484262144 00000100:00100000:1.0:1789302633.022068:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484262144 00000100:00100000:1.0:1789302633.022136:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 198 00000100:00100000:1.0:1789302633.022147:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+36:11594:x1876219484262144:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302633.022175:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302633.022199:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f122b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b394d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.022382:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.022397:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.022408:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.022422:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.022429:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.022434:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789302633.024205:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789302633.024434:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024450:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024460:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024497:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024504:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024511:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024517:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361ab400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302633.024521:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024528:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024551:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:0.0:1789302633.024554:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302633.024560:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024566:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab400/0x20be524657f122b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302633.024580:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed90ca0d reply state 000000006f8c171d transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302633.024589:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789302633.024623:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab600/0x20be524657f122b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024637:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.024644:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a69061a7800) 00010000:00010000:0.0:1789302633.024646:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302633.024649:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8800, rc 0) 00000100:00100000:0.0:1789302633.025005:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+39:11594:x1876219484262144:12345-192.168.203.42@tcp:101:bash.0 Request processed in 2858us (3107us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789302633.025015:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 198 00010000:00010000:3.0:1789302633.029224:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.029242:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.029250:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.029269:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302633.029274:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.029282:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.029344:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a69051af300) 00010000:00010000:3.0:1789302633.029348:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302633.029354:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.029361:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa000/0x20be524657f122bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.035952:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.038200:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484262272 00000100:00100000:3.0:1789302633.038215:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484262272 00000100:00100000:3.0:1789302633.038330:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:3.0:1789302633.038342:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2353:x1876219484262272:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789302633.038359:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302633.038378:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3954 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302633.038405:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302633.038425:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1789302633.038429:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302633.038437:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.038476:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.038489:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6200, rc 0) 00000100:00100000:3.0:1789302633.038549:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484262272:12345-192.168.203.42@tcp:101:bash.0 Request processed in 210us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.038556:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00080000:0.0:1789302633.039030:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302633.046604:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302633.046977:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484262400 00000100:00100000:0.0:1789302633.046987:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484262400 00000100:00100000:0.0:1789302633.047045:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789302633.047056:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+6:11594:x1876219484262400:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302633.047086:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302633.047104:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b395b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.047136:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.047145:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302633.047149:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302633.047154:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.047186:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.047200:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 7 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302633.047213:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876219505223040:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302633.047347:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302633.050513:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6699:1876219505223040:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302633.050551:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.050574:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9c00, rc 0) 00000100:00100000:0.0:1789302633.050654:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:11594:x1876219484262400:12345-192.168.203.42@tcp:101:bash.0 Request processed in 3599us (4059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302633.051176:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:2.0:1789302633.051348:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302633.051444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484262528 00000100:00100000:0.0:1789302633.051453:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484262528 00010000:00010000:0.0:1789302633.051485:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 7 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302633.051521:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:0.0:1789302633.051532:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484262528:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302633.051546:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302633.051571:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 7 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.051583:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 7 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.051608:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f122d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3954 expref: 7 pid: 6696 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.051622:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302633.051627:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302633.051635:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.051644:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.051703:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302633.051717:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1876219505223168:192.168.203.42@tcp:105: 00000100:00100000:0.0:1789302633.051795:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302633.063850:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1876219505223168:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789302633.063878:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302633.063941:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2352:x1876219484262528:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 12410us (12592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302633.063953:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 75 00000100:00100000:1.0:1789302633.064576:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.064688:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484262784 00000100:00100000:3.0:1789302633.064698:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484262784 00000100:00100000:3.0:1789302633.064748:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:3.0:1789302633.064758:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+38:11594:x1876219484262784:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:3.0:1789302633.065099:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+39:11594:x1876219484262784:12345-192.168.203.42@tcp:35:bash.0 Request processed in 341us (524us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789302633.065107:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:2.0:1789302633.273387:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302633.273786:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484262912 00000100:00100000:0.0:1789302633.273806:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484262912 00000100:00100000:0.0:1789302633.273869:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 199 00000100:00100000:0.0:1789302633.273880:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+39:11610:x1876219484262912:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302633.273906:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302633.273928:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9600/0x20be524657f122e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3962 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.273993:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f122e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.274007:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f122e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.274019:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f122e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302633.274084:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789302633.274088:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302633.274106:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f122e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.274131:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9600/0x20be524657f122e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3962 expref: 41 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.274151:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f122e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3962 expref: 40 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.274160:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:0.0:1789302633.274163:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302633.274167:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9000, rc 0) 00000100:00100000:0.0:1789302633.274231:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+40:11610:x1876219484262912:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 352us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302633.274239:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 199 00000100:00100000:1.0:1789302633.282717:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.282829:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484263168 00000100:00100000:2.0:1789302633.282839:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484263168 00000100:00100000:2.0:1789302633.282905:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 200 00000100:00100000:2.0:1789302633.282931:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+40:11610:x1876219484263168:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302633.282953:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302633.282975:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f122f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3969 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.283088:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f122f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.283103:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f122f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.283115:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f122f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302633.283127:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789302633.283254:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f122f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3969 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.283272:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f122f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3969 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.283280:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a69061a7800) 00010000:00010000:2.0:1789302633.283283:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302633.283521:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9400, rc 0) 00000100:00100000:2.0:1789302633.283588:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+42:11610:x1876219484263168:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 659us (895us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789302633.283597:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 200 00000100:00100000:1.0:1789302633.291642:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302633.291685:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302633.291707:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484263296 00000100:00100000:0.0:1789302633.291717:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484263296 00000100:00100000:0.0:1789302633.291794:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:0.0:1789302633.291814:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+42:2352:x1876219484263296:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302633.291830:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789302633.291852:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484263552 00010000:00010000:0.0:1789302633.291854:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9400/0x20be524657f122f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3969 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.291856:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484263552 00010000:00010000:0.0:1789302633.291873:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a69061a7800) 00010000:00010000:0.0:1789302633.291883:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302633.291901:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 201 00000100:00100000:2.0:1789302633.291907:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+42:11610:x1876219484263552:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302633.291928:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789302633.291933:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+42:2352:x1876219484263296:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 122us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302633.291940:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00010000:00010000:2.0:1789302633.291942:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12305 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3970 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.292032:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1230c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.292045:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1230c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.292056:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1230c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302633.292072:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789302633.292194:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12305 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3970 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.292221:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1230c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3970 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.292228:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a69061a7800) 00010000:00010000:2.0:1789302633.292231:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789302633.292234:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8800, rc 0) 00000100:00100000:2.0:1789302633.292272:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+43:11610:x1876219484263552:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 365us (585us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789302633.292279:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 201 00000100:00100000:1.0:1789302633.297858:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.297940:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484263680 00000100:00100000:3.0:1789302633.297950:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484263680 00000100:00100000:3.0:1789302633.298007:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:3.0:1789302633.298018:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+6:2353:x1876219484263680:12345-192.168.203.42@tcp:1:lfs.0 00010000:00010000:3.0:1789302633.298061:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.298092:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.298119:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302633.298125:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302633.298130:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.298168:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.298183:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 6 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302633.298199:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1876219505223296:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302633.298337:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302633.304889:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fdd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1876219505223296:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302633.304920:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302633.305388:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.305489:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484263808 00000100:00100000:2.0:1789302633.305511:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484263808 00002000:00100000:2.0:1789302633.305560:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a69362d2680 x1876219484263808/t0(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:209/0 lens 504/0 e 0 to 0 dl 1789302644 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302633.305570:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69362d2680 with x1876219484263808 ext(0->8) 00010000:00010000:2.0:1789302633.305578:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 7 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.305594:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 7 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302633.305602:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69362d2680 00000100:00100000:2.0:1789302633.305635:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:2.0:1789302633.305645:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484263808:12345-192.168.203.42@tcp:4:lfs.0 00000100:00100000:2.0:1789302633.307713:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484263808:12345-192.168.203.42@tcp:4:lfs.0 Request processed in 2056us (2314us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789302633.307726:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00002000:00100000:2.0:1789302633.307737:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a69362d2680 x1876219484263808/t4294967308(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:209/0 lens 504/448 e 0 to 0 dl 1789302644 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789302633.307746:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a69362d2680 with x1876219484263808 ext(0->8) 00010000:00010000:2.0:1789302633.307757:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 9 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.307776:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 9 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302633.307805:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a69362d2680 00000100:00100000:0.0:1789302633.313696:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.313808:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484263936 00000100:00100000:2.0:1789302633.313818:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484263936 00010000:00010000:2.0:1789302633.313872:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 9 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.313963:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:2.0:1789302633.313975:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+9:2352:x1876219484263936:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302633.313993:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789302633.314013:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789302633.314017:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789302632 00002000:00010000:2.0:1789302633.314019:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789302632 00002000:00010000:2.0:1789302633.314022:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789302632 00010000:00010000:2.0:1789302633.314029:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 9 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.314043:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 9 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.314067:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f122db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b395b expref: 9 pid: 6699 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.314097:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302633.314102:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302633.314107:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.314130:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.314165:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302633.314223:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484263936:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 251us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302633.314232:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 76 00010000:00010000:3.0:1789302633.314541:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.314552:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.314578:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.314595:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.314603:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.314611:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302633.314615:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.314625:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.314637:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.314644:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8db6adb/0x20be524657f1231a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302633.314715:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2353:x1876219484263680:12345-192.168.203.42@tcp:1:lfs.0 Request processed in 16698us (16874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.314723:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789302633.320170:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.321393:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484264192 00000100:00100000:3.0:1789302633.321405:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484264192 00000100:00100000:3.0:1789302633.321464:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:3.0:1789302633.321487:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6904986c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+43:11610:x1876219484264192:12345-192.168.203.42@tcp:35:lfs.0 00000004:00010000:3.0:1789302633.321550:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1230c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3970 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302633.321784:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1789302633.321833:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789302633.324953:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1789302633.325979:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.326002:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.326012:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.326062:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.326085:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 47 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302633.326100:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fdd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876219505223424:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302633.328922:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302633.329792:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302633.329932:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302633.329971:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.329984:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484264320 00000100:00100000:2.0:1789302633.329994:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484264320 00000100:00100000:1.0:1789302633.330000:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484264576 00000100:00100000:1.0:1789302633.330019:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484264576 00000100:00100000:2.0:1789302633.330056:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 296 00000100:00100000:2.0:1789302633.330068:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484264320:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302633.330138:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484264320:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302633.330145:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 296 00000100:00100000:3.0:1789302633.330326:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484264448 00000100:00100000:3.0:1789302633.330331:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484264448 00000100:00100000:3.0:1789302633.330367:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:3.0:1789302633.330375:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484264448:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302633.330428:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484264448:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 53us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.330435:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:1.0:1789302633.330704:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 156 00000100:00100000:1.0:1789302633.330713:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484264576:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302633.330752:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484264576:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 40us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302633.330758:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 156 00000100:00100000:3.0:1789302633.333932:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fdd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1876219505223424:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302633.333964:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789302633.334780:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302633.337971:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.338232:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484264704 00000100:00100000:3.0:1789302633.338242:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484264704 00010000:00010000:3.0:1789302633.338282:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 48 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302633.338435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:3.0:1789302633.338445:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+48:2352:x1876219484264704:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302633.338462:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302633.338480:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 48 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.338493:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 48 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.338514:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8800/0x20be524657f122c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b394d expref: 48 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.338545:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a69061a7800) 00010000:00010000:3.0:1789302633.338550:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.338570:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.338578:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.338900:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302633.338963:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+47:2352:x1876219484264704:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 519us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.338971:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 77 00010000:00010000:0.0:1789302633.339162:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.339172:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789302633.339321:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1789302633.340331:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789302633.340463:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505223552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789302633.340951:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302633.341022:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789302633.341125:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505223552 00000100:00100000:3.0:1789302633.341133:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505223552 00000100:00100000:3.0:1789302633.341360:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789302633.341371:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505223552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789302633.341453:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505223552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.341460:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789302633.341693:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302633.342724:0:5848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1789302633.342734:0:5848:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1789302633.342757:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a693c50ca80, transno 4294967307 00000100:00100000:2.0:1789302633.342826:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505223552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789302633.343381:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789302633.343463:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505223680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789302633.343531:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302633.343563:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690492f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302633.343679:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505223680 00000100:00100000:1.0:1789302633.343687:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505223680 00000100:00100000:1.0:1789302633.343724:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302633.343730:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876219505223680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789302633.344820:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1876219505223680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1085us (1297us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789302633.344831:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789302633.346302:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1876219505223680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789302633.346389:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789302633.346460:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.346471:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.346478:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.346484:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302633.346489:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.346496:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.346510:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a69061a7800) 00010000:00010000:2.0:1789302633.346513:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789302633.346877:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.346885:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12321 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302633.347522:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789302633.347614:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789302633.347626:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344533339819ns, next at 345533337064ns, rc = 0 00000001:00080000:2.0:1789302633.347634:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789302633.347814:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a69061a7800) 00010000:00010000:2.0:1789302633.347819:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789302633.347828:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f1230c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3970 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.348023:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6904986c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+50:11610:x1876219484264192:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 26537us (27860us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789302633.348033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000020:00080000:2.0:1789302633.348039:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789302633.351988:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.353202:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484264832 00000100:00100000:2.0:1789302633.353216:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484264832 00000100:00100000:2.0:1789302633.353316:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 202 00000100:00100000:2.0:1789302633.353328:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+50:11610:x1876219484264832:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302633.353356:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302633.353380:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12328 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3977 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.353571:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12328 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3977 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.353589:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12328 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3977 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.353608:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302633.353611:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302633.353615:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9600, rc 0) 00000100:00100000:2.0:1789302633.353851:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+51:11610:x1876219484264832:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 526us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302633.353859:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 202 00000100:00100000:0.0:1789302633.358768:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.359232:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484265088 00000100:00100000:2.0:1789302633.359243:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484265088 00000100:00100000:2.0:1789302633.359344:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789302633.359355:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+51:11610:x1876219484265088:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789302633.360214:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+52:11610:x1876219484265088:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 856us (1449us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789302633.360224:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:1.0:1789302633.462999:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.463108:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484265216 00000100:00100000:3.0:1789302633.463119:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484265216 00000100:00100000:3.0:1789302633.463209:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 203 00000100:00100000:3.0:1789302633.463219:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+52:11620:x1876219484265216:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:3.0:1789302633.463327:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463344:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463354:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463384:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463392:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463398:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463507:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463516:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463522:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789302633.463562:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463575:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463581:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463587:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463593:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302633.463596:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463610:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463621:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302633.463624:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302633.463629:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463635:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1232f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463651:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463656:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463661:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463665:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302633.463668:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463673:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463680:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039300) 00010000:00010000:3.0:1789302633.463682:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302633.463684:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463699:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12336 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463714:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463719:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463725:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463729:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302633.463732:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463737:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463744:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:3.0:1789302633.463746:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302633.463749:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.463754:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1233d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302633.463830:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+52:11620:x1876219484265216:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 611us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.463849:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 203 00000100:00100000:0.0:1789302633.503697:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.503788:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484265472 00000100:00100000:3.0:1789302633.503808:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484265472 00000100:00100000:3.0:1789302633.503879:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 204 00000100:00100000:3.0:1789302633.503888:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+52:11623:x1876219484265472:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302633.503908:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302633.503930:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12344 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b397e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504001:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504016:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504028:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504043:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504050:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504056:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504189:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504198:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504220:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302633.504230:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789302633.504352:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504360:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504365:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504371:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302633.504375:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504381:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504391:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302633.504394:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302633.504398:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504403:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f1234b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504418:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504423:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504434:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504439:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302633.504442:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504448:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504456:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6904039300) 00010000:00010000:3.0:1789302633.504458:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302633.504460:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504465:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504503:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12344 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504516:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.504524:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:3.0:1789302633.504526:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302633.504528:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6a00, rc 0) 00000100:00100000:3.0:1789302633.504594:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+54:11623:x1876219484265472:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 706us (905us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789302633.504610:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 204 00000100:00100000:0.0:1789302633.515643:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.515741:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484265600 00000100:00100000:2.0:1789302633.515751:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484265600 00000100:00100000:2.0:1789302633.515888:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 205 00000100:00100000:2.0:1789302633.515899:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+54:11623:x1876219484265600:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:2.0:1789302633.515965:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.515980:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.515991:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.516015:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.516021:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.516028:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.516034:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302633.516040:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.516063:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.516075:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302633.516078:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302633.516083:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.516089:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.516162:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+54:11623:x1876219484265600:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 265us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302633.516169:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 205 00000100:00100000:1.0:1789302633.519262:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.519472:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484265856 00000100:00100000:2.0:1789302633.519482:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484265856 00000100:00100000:2.0:1789302633.519667:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:2.0:1789302633.519678:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+54:11623:x1876219484265856:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789302633.519926:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+55:11623:x1876219484265856:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 250us (673us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789302633.519933:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00010000:00010000:0.0:1789302633.549489:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302633.616895:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.617032:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484266112 00000100:00100000:3.0:1789302633.617041:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484266112 00000100:00100000:3.0:1789302633.617116:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 206 00000100:00100000:3.0:1789302633.617125:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+55:11633:x1876219484266112:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789302633.617150:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302633.617153:0:9859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302633.617179:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f122e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3962 expref: 55 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.617201:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302633.617206:0:9859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302633.617220:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1236e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3985 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.617360:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.617375:0:9859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.617383:0:9859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.617413:0:9859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.617428:0:9859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 55 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302633.617455:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505223808:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302633.617556:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13540 going to sleep for 11 seconds 00000100:00100000:3.0:1789302633.620690:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fdd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505223808:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302633.620727:0:9859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302633.621143:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.621231:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484266240 00000100:00100000:2.0:1789302633.621239:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484266240 00010000:00010000:2.0:1789302633.621278:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 56 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.621342:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:2.0:1789302633.621352:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+56:2352:x1876219484266240:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302633.621385:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302633.621392:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 56 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.621405:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 56 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.621425:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6a00/0x20be524657f12359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b397e expref: 56 pid: 5845 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.621444:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302633.621448:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.621458:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.621466:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.621490:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302633.621547:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+55:2352:x1876219484266240:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 196us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302633.621555:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 78 00010000:00010000:0.0:1789302633.621819:0:9859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.621827:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302633.621846:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789302633.622007:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f1236e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 56 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.622026:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 55 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.622034:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302633.622037:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789302633.622039:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:0.0:1789302633.622084:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+55:11633:x1876219484266112:12345-192.168.203.42@tcp:101:bash.0 Request processed in 4960us (5201us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789302633.622091:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 206 00000100:00100000:0.0:1789302633.629394:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.629570:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484266496 00000100:00100000:2.0:1789302633.629581:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484266496 00000100:00100000:2.0:1789302633.629642:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 207 00000100:00100000:2.0:1789302633.629653:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+55:11633:x1876219484266496:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:2.0:1789302633.629948:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.629966:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.629977:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302633.630029:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1789302633.630054:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce1901d4 reply state 000000004420d74c transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.630063:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302633.630249:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+58:11633:x1876219484266496:12345-192.168.203.42@tcp:36:bash.0 Request processed in 597us (863us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789302633.630257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 207 00000020:00080000:2.0:1789302633.630262:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789302633.634016:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00010000:00010000:3.0:1789302633.634142:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.634155:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.634163:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.634169:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302633.634175:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.634182:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.634199:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:3.0:1789302633.634202:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302633.634206:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.634213:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f12383 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302633.635830:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484266624 00000100:00100000:0.0:1789302633.635845:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484266624 00000100:00100000:0.0:1789302633.635912:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 208 00000100:00100000:0.0:1789302633.635923:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+57:11633:x1876219484266624:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302633.635948:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302633.635968:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9e00/0x20be524657f1238a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b398c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.636049:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.636063:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 58 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.636072:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.636116:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 58 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.636129:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 58 pid: 9859 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302633.636142:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505223936:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302633.636377:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302633.638738:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505223936:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302633.638769:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302633.640450:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302633.640822:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484266752 00000100:00100000:1.0:1789302633.640832:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484266752 00010000:00010000:1.0:1789302633.640871:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 59 pid: 9859 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302633.640963:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:1.0:1789302633.640975:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+59:2351:x1876219484266752:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302633.640992:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302633.641012:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 59 pid: 9859 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.641026:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 59 pid: 9859 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.641048:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12375 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3985 expref: 59 pid: 9859 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.641067:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:1.0:1789302633.641073:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.641082:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.641090:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.641119:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302633.641363:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+58:2351:x1876219484266752:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 389us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302633.641372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 79 00010000:00010000:0.0:1789302633.641441:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.641450:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302633.641497:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789302633.641502:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302633.641523:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.641556:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9e00/0x20be524657f1238a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.641571:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.641592:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302633.641595:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302633.641597:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8600, rc 0) 00000100:00100000:0.0:1789302633.641623:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+57:11633:x1876219484266624:12345-192.168.203.42@tcp:101:bash.0 Request processed in 5703us (7616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302633.641630:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 208 00000100:00100000:3.0:1789302633.644502:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302633.644644:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484267008 00000100:00100000:0.0:1789302633.644655:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484267008 00000100:00100000:0.0:1789302633.644715:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:0.0:1789302633.644724:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+57:11633:x1876219484267008:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:0.0:1789302633.644977:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+58:11633:x1876219484267008:12345-192.168.203.42@tcp:35:bash.0 Request processed in 252us (483us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789302633.644984:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:0.0:1789302633.712664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.713460:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484267136 00000100:00100000:3.0:1789302633.713480:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484267136 00000100:00100000:3.0:1789302633.713580:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 209 00000100:00100000:3.0:1789302633.713594:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+58:11639:x1876219484267136:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:3.0:1789302633.713632:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302633.713661:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12398 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3993 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.713777:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1239f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.713803:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1239f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.713819:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1239f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302633.714469:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789302633.714475:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302633.714499:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1239f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.714534:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3993 expref: 60 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.714563:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1239f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3993 expref: 59 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.714600:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302633.714604:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302633.714609:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6200, rc 0) 00000100:00100000:3.0:1789302633.715210:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+59:11639:x1876219484267136:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1615us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.715222:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 209 00000100:00100000:3.0:1789302633.720986:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302633.721114:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484267264 00000100:00100000:1.0:1789302633.721134:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484267264 00000100:00100000:1.0:1789302633.721697:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 210 00000100:00100000:1.0:1789302633.721709:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+59:11639:x1876219484267264:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302633.721731:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302633.721756:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f123a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b399a expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.721930:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.721944:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.721954:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.721968:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.721973:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.721979:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.722069:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f123bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.722078:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f123bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.722086:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f123bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302633.722123:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789302633.722127:0:6295:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302633.723215:0:6295:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f123bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723255:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f123bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723264:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723270:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723277:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723296:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302633.723301:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723309:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723323:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:1.0:1789302633.723326:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302633.723331:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723336:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa200/0x20be524657f123ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723352:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723358:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723369:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723374:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aba00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302633.723377:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723383:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723389:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a69051afe00) 00010000:00010000:1.0:1789302633.723391:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302633.723394:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723400:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aba00/0x20be524657f123b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723457:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aae00/0x20be524657f123a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b399a expref: 61 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723472:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f123bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b399a expref: 60 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302633.723479:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:1.0:1789302633.723481:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302633.723484:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361abc00, rc 0) 00000100:00100000:1.0:1789302633.723562:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+60:11639:x1876219484267264:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1855us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302633.723580:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 210 00000100:00100000:1.0:1789302633.728787:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302633.729520:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484267520 00000100:00100000:0.0:1789302633.729537:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484267520 00000100:00100000:0.0:1789302633.729622:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 211 00000100:00100000:0.0:1789302633.729636:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+60:11639:x1876219484267520:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302633.729669:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302633.729700:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8a00/0x20be524657f123c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39a1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302633.731082:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.731534:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484267648 00000100:00100000:2.0:1789302633.731547:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484267648 00000100:00100000:2.0:1789302633.731628:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:2.0:1789302633.731640:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+62:2351:x1876219484267648:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302633.731657:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302633.731690:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361abc00/0x20be524657f123bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b399a expref: 62 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.731714:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302633.731740:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302633.732080:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ace2f696-3715-4928-b36c-02db3411d1a3+61:2351:x1876219484267648:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 440us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302633.732089:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00010000:00010000:0.0:1789302633.732253:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.732310:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.732321:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.732365:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.732384:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 60 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302633.732402:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505224064:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302633.732486:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302633.737722:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302633.737940:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505224064:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302633.737975:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302633.738119:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484267776 00000100:00100000:3.0:1789302633.738129:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484267776 00010000:00010000:3.0:1789302633.738191:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302633.738242:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:3.0:1789302633.738253:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+61:2351:x1876219484267776:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302633.738281:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302633.738339:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.738354:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.738383:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f12391 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b398c expref: 61 pid: 5847 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.738404:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:3.0:1789302633.738430:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.738442:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.738451:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.738476:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302633.738553:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+60:2351:x1876219484267776:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 301us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.738561:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 80 00010000:00010000:0.0:1789302633.739158:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.739168:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302633.739193:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789302633.739443:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8a00/0x20be524657f123c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.739477:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302633.739485:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302633.739489:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789302633.739491:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9c00, rc 0) 00000100:00100000:0.0:1789302633.739549:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c76d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+60:11639:x1876219484267520:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 9916us (10796us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789302633.739557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 211 00000100:00100000:1.0:1789302633.743018:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.743186:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484268032 00000100:00100000:2.0:1789302633.743200:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484268032 00000100:00100000:3.0:1789302633.743429:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:3.0:1789302633.743445:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+60:11639:x1876219484268032:12345-192.168.203.42@tcp:103:lfs.0 00010000:00010000:3.0:1789302633.743466:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302633.743499:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12328 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3977 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.743524:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:3.0:1789302633.743530:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302633.743604:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+59:11639:x1876219484268032:12345-192.168.203.42@tcp:103:lfs.0 Request processed in 162us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.743612:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:2.0:1789302633.747023:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302633.750327:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484268160 00000100:00100000:3.0:1789302633.750355:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484268160 00000100:00100000:3.0:1789302633.750628:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 212 00000100:00100000:3.0:1789302633.750641:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+59:11639:x1876219484268160:12345-192.168.203.42@tcp:58:lfs.0 00010000:00010000:3.0:1789302633.750985:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.751009:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302633.751024:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302633.751661:0:9859:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789302633.751994:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+59:11639:x1876219484268160:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 1351us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302633.752005:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 212 00000100:00100000:1.0:1789302633.760519:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302633.760855:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484268288 00000100:00100000:2.0:1789302633.760870:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484268288 00000100:00100000:2.0:1789302633.760954:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 213 00000100:00100000:2.0:1789302633.760966:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+59:11639:x1876219484268288:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302633.760993:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302633.762123:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39a8 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.762474:0:6295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.762490:0:6295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a8 expref: 60 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.762514:0:6295:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.762532:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a8 expref: 60 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.762548:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302633.762551:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302633.762573:0:6295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a8 expref: 60 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302633.762581:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9600, rc 0) 00000100:00100000:2.0:1789302633.762674:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+60:11639:x1876219484268288:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1709us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302633.762684:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 213 00000040:00080000:1.0:1789302634.510684:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302634.510697:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789302634.510751:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789302634.510760:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789302634.510959:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362ab480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505224192:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789302634.511104:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9240 going to sleep for 11 seconds 00000100:00100000:0.0:1789302634.514262:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362ab480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505224192:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789302634.515606:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.515857:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484268416 00000100:00100000:0.0:1789302634.515869:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484268416 00000100:00080000:2.0:1789302634.515942:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302634.515955:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 214 00000100:00100000:0.0:1789302634.515967:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+60:11640:x1876219484268416:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789302634.516007:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789302634.516130:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+60:11640:x1876219484268416:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 165us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302634.516140:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 214 00000100:00100000:1.0:1789302634.522562:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.527999:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484268544 00000100:00100000:3.0:1789302634.528022:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484268544 00000100:00100000:3.0:1789302634.528194:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 215 00000100:00100000:3.0:1789302634.528207:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+60:11640:x1876219484268544:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789302634.528341:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528363:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528380:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528567:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528593:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528620:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528655:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528664:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528669:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302634.528714:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789302634.528718:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302634.528732:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528743:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528750:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528757:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528832:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302634.528837:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528846:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528867:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:3.0:1789302634.528870:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302634.528876:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528882:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f123e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528902:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528908:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528914:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528918:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302634.528921:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528928:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528935:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9a6904039300) 00010000:00010000:3.0:1789302634.528938:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302634.528941:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528946:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f123ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528972:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528978:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528984:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528989:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302634.528992:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.528998:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.529006:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:3.0:1789302634.529008:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302634.529011:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.529017:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f123f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302634.529261:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+60:11640:x1876219484268544:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 984us (6644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302634.529271:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 215 00000100:00100000:1.0:1789302634.539270:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.539855:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484268800 00000100:00100000:2.0:1789302634.539866:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484268800 00000100:00100000:2.0:1789302634.539930:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 216 00000100:00100000:2.0:1789302634.539941:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+60:11640:x1876219484268800:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302634.539960:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302634.539981:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f123fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39af expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540179:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540205:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540217:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302634.540228:0:6295:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789302634.540511:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540520:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540540:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540546:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302634.540551:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540559:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540571:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302634.540574:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789302634.540579:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540585:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540630:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f123fa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39af expref: 62 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540640:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:2.0:1789302634.540642:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302634.540646:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f123fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39af expref: 62 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.540655:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9e00, rc 0) 00000100:00100000:2.0:1789302634.540717:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+61:11640:x1876219484268800:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 779us (1456us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1789302634.540733:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 216 00000100:00100000:1.0:1789302634.543846:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.544125:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484268928 00000100:00100000:0.0:1789302634.544136:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484268928 00000100:00100000:0.0:1789302634.544205:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 217 00000100:00100000:0.0:1789302634.544216:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+61:11640:x1876219484268928:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789302634.544249:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789302634.544389:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+61:11640:x1876219484268928:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 175us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302634.544410:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 217 00000100:00100000:1.0:1789302634.559055:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.559224:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484269184 00000100:00100000:3.0:1789302634.559242:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484269184 00000100:00100000:3.0:1789302634.559393:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 218 00000100:00100000:3.0:1789302634.559425:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+61:11640:x1876219484269184:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302634.559459:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302634.559463:0:9859:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789302634.559498:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f1239f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3993 expref: 61 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.559530:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:3.0:1789302634.559538:0:9859:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302634.559558:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1240f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39b6 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789302634.560114:0:9859:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789302634.560417:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.560433:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.560446:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.560512:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f1240f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39b6 expref: 63 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.560531:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39b6 expref: 62 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.560540:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039300) 00010000:00010000:3.0:1789302634.560543:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302634.560556:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302634.560642:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+62:11640:x1876219484269184:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1219us (1600us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789302634.560651:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 218 00000100:00100000:1.0:1789302634.570856:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.570968:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484269440 00000100:00100000:2.0:1789302634.570981:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484269440 00000100:00100000:2.0:1789302634.571055:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 219 00000100:00100000:2.0:1789302634.571068:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+62:11640:x1876219484269440:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789302634.571156:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302634.571192:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6400/0x20be524657f12416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39b6 expref: 62 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571222:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039300) 00010000:00010000:2.0:1789302634.571236:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302634.571277:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571348:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571361:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571380:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571388:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571395:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571512:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571521:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571529:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571537:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302634.571543:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571553:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571562:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:2.0:1789302634.571566:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302634.571571:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571578:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12424 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571590:0:6295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571596:0:6295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571603:0:6295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571614:0:6295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302634.571618:0:6295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571625:0:6295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571633:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfe4674f1 (ffff9a6907c68600) 00010000:00010000:2.0:1789302634.571635:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302634.571638:0:6295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.571643:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f1242b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfe4674f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302634.571754:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+61:11640:x1876219484269440:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 688us (922us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789302634.571762:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 219 00010000:00010000:2.0:1789302634.573832:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302634.575607:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.575733:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484269568 00000100:00100000:3.0:1789302634.575747:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484269568 00000100:00100000:3.0:1789302634.575828:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 220 00000100:00100000:3.0:1789302634.575855:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+61:11640:x1876219484269568:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302634.575884:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302634.575915:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12432 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39bd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.575963:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.575980:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.575995:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.576132:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.576160:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.576171:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:3.0:1789302634.576174:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789302634.576188:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6200, rc 0) 00000100:00100000:3.0:1789302634.576281:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+62:11640:x1876219484269568:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 430us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302634.576332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 220 00000100:00100000:1.0:1789302634.584852:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.584952:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484269824 00000100:00100000:2.0:1789302634.584965:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484269824 00000100:00100000:2.0:1789302634.585039:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 221 00000100:00100000:2.0:1789302634.585052:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+62:11640:x1876219484269824:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789302634.585168:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.585189:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.585225:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302634.585598:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789302634.585611:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345771324565ns, next at 346771320744ns, rc = 0 00000004:00010000:2.0:1789302634.585728:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077643834 reply state 000000003f4172f4 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302634.585739:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302634.585871:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+64:11640:x1876219484269824:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 821us (1043us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789302634.585880:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 221 00010000:00010000:3.0:1789302634.588120:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.588142:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.588151:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.588157:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302634.588163:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.588172:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.588193:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:3.0:1789302634.588197:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789302634.588202:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.588210:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12440 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302634.594778:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.594883:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484269952 00000100:00100000:2.0:1789302634.594898:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484269952 00000100:00100000:2.0:1789302634.594975:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 222 00000100:00100000:2.0:1789302634.594987:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+63:11640:x1876219484269952:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302634.595018:0:6295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302634.595044:0:6295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39c4 expref: -99 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.595122:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 64 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.595139:0:6295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 64 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.595162:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:2.0:1789302634.595183:0:6295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302634.595188:0:6295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9e00, rc 0) 00000100:00100000:2.0:1789302634.595313:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+64:11640:x1876219484269952:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 298us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302634.595321:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 222 00000100:00100000:1.0:1789302634.605602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.606116:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484270080 00000100:00100000:2.0:1789302634.606140:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484270080 00000100:00100000:2.0:1789302634.606366:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:2.0:1789302634.606381:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+9:2352:x1876219484270080:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789302634.607444:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+10:2352:x1876219484270080:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 1058us (1848us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789302634.607456:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00080000:0.0:1789302634.607865:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302634.611133:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.611454:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484270336 00000100:00100000:0.0:1789302634.611469:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484270336 00000100:00100000:0.0:1789302634.611550:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:0.0:1789302634.611563:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+64:11640:x1876219484270336:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789302634.611923:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+65:11640:x1876219484270336:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 363us (806us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789302634.611931:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:1.0:1789302634.618120:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.618537:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484270592 00000100:00100000:3.0:1789302634.618550:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484270592 00000100:00100000:3.0:1789302634.618635:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 223 00000100:00100000:3.0:1789302634.618648:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+65:11640:x1876219484270592:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789302634.618820:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+65:11640:x1876219484270592:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 175us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302634.618837:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 223 00000100:00100000:1.0:1789302634.630428:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.630529:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484270720 00000100:00100000:2.0:1789302634.630543:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484270720 00000100:00100000:2.0:1789302634.630659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 224 00000100:00100000:2.0:1789302634.630672:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+65:11640:x1876219484270720:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302634.630713:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302634.630743:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f1244e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39cb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.630853:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.630870:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.630884:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302634.630961:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302634.630988:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.631024:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f1244e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39cb expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.631046:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39cb expref: 66 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.631054:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:2.0:1789302634.631057:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789302634.631061:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8800, rc 0) 00000100:00100000:2.0:1789302634.631144:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+66:11640:x1876219484270720:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 475us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302634.631152:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 224 00000100:00100000:1.0:1789302634.640887:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.644193:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484270848 00000100:00100000:3.0:1789302634.644209:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484270848 00000100:00100000:3.0:1789302634.644364:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:3.0:1789302634.644380:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+10:2351:x1876219484270848:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302634.644399:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302634.644423:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39d2 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789302634.644452:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa69769, blocks: 0x1 00010000:00010000:3.0:1789302634.644473:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1789302634.644488:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302634.644496:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.644512:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.644526:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:3.0:1789302634.646103:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+11:2351:x1876219484270848:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1720us (5216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302634.646113:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:1.0:1789302634.651875:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.655480:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484271104 00000100:00100000:0.0:1789302634.655497:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484271104 00000100:00100000:0.0:1789302634.655641:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 225 00000100:00100000:0.0:1789302634.656076:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+66:11640:x1876219484271104:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789302634.656195:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+66:11640:x1876219484271104:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 126us (4331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302634.656203:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 225 00000100:00100000:1.0:1789302634.660183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.660328:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484271232 00000100:00100000:3.0:1789302634.660359:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484271232 00000100:00100000:3.0:1789302634.660433:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:3.0:1789302634.660444:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+11:11640:x1876219484271232:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302634.660467:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302634.660491:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39d9 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.660533:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.660543:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302634.660548:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302634.660555:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.660842:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.660859:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 12 pid: 6697 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302634.660877:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1876219505224320:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302634.660992:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13480 going to sleep for 11 seconds 00000100:00100000:1.0:1789302634.668634:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.668796:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484271360 00000100:00100000:0.0:1789302634.668810:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484271360 00010000:00010000:0.0:1789302634.668871:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 13 pid: 6697 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.668925:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:0.0:1789302634.668937:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+13:2351:x1876219484271360:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302634.668960:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302634.669014:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 13 pid: 6697 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.669030:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 13 pid: 6697 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.669063:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302634.669068:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302634.669078:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.669092:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.669142:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.669159:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1876219505224448:192.168.203.42@tcp:105: 00000100:00100000:0.0:1789302634.669279:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1fb40 going to sleep for 11 seconds 00010000:00010000:3.0:1789302634.672922:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1245c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d2 expref: 13 pid: 6697 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302634.672985:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1876219505224320:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302634.673027:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.673047:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7200, rc 0) 00000100:00100000:2.0:1789302634.674050:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+12:11640:x1876219484271232:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 13599us (13872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302634.674064:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:0.0:1789302634.678929:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5832:1876219505224448:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789302634.678963:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302634.679034:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ace2f696-3715-4928-b36c-02db3411d1a3+11:2351:x1876219484271360:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10099us (10422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302634.679048:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:1.0:1789302634.691227:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.691404:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484271488 00000100:00100000:3.0:1789302634.691419:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484271488 00002000:00100000:3.0:1789302634.691493:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9a6936c50700 x1876219484271488/t0(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:210/0 lens 504/0 e 0 to 0 dl 1789302645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789302634.691506:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936c50700 with x1876219484271488 ext(0->12) 00002000:00010000:3.0:1789302634.691513:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6936c50700 00000100:00100000:3.0:1789302634.691558:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:3.0:1789302634.691570:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+11:2352:x1876219484271488:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789302634.692434:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:2352:x1876219484271488:12345-192.168.203.42@tcp:4:lhsmtool_posix.0 Request processed in 861us (1217us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789302634.692445:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00002000:00100000:3.0:1789302634.692455:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9a6936c50700 x1876219484271488/t4294967320(0) o4->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:210/0 lens 504/448 e 0 to 0 dl 1789302645 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789302634.692465:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936c50700 with x1876219484271488 ext(0->12) 00002000:00010000:3.0:1789302634.692471:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6936c50700 00000100:00100000:2.0:1789302634.703542:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.703822:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484271616 00000100:00100000:0.0:1789302634.703846:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484271616 00000100:00100000:0.0:1789302634.703942:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 226 00000100:00100000:0.0:1789302634.703953:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+66:11640:x1876219484271616:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789302634.797277:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:3.0:1789302634.797355:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1789302634.797398:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1789302634.797415:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789302634.797431:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a690492f0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789302634.797436:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a690bbc4b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6906186900 00000020:00080000:3.0:1789302634.797439:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a690bbc4300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a690c58cc00 00000020:00080000:3.0:1789302634.797459:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6906150c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789302634.797462:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a693ff1bc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6906150480 00000020:00080000:3.0:1789302634.797464:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a693ff1b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6936c76800 00000020:00080000:3.0:1789302634.797676:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789302634.797876:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789302634.797896:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505224576:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789302634.797961:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302634.798021:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302634.798028:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505224704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789302634.798048:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302634.798074:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505224832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789302634.798096:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302634.798129:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505224576 00000100:00100000:3.0:1789302634.798136:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505224576 00000100:00100000:3.0:1789302634.798183:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505224704 00000100:00100000:3.0:1789302634.798186:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505224704 00000100:00100000:3.0:1789302634.798196:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505224832 00000100:00100000:3.0:1789302634.798198:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505224832 00000100:00100000:3.0:1789302634.798211:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789302634.798219:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505224576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789302634.798243:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1789302634.798275:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798320:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798329:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789302634.798334:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302634.798339:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798366:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798381:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 12 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302634.798393:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876219505224960:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302634.798453:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302634.798470:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789302634.798478:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505224704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789302634.798596:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789302634.798601:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789302633 00002000:00010000:3.0:1789302634.798604:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789302634.798606:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789302633 -> 1789302633 00002000:00010000:3.0:1789302634.798609:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789302634.798653:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3303:x1876219505224704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (602us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789302634.798661:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789302634.798680:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789302634.798686:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876219505224832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789302634.798698:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789302634.798719:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa69768, atime: 0x6aa69768, ctime: 0x6aa69768, blocks: 0x1 00010000:00010000:3.0:1789302634.798724:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798735:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1789302634.798738:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302634.798744:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798759:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798771:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798779:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.798809:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789302634.799234:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505224832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 548us (1135us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789302634.799251:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1789302634.799439:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6935fdea00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789302634.799446:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505224832:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789302634.799471:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6935fde680/2, rc 0, transno 4294967321 00000100:00100000:3.0:1789302634.799476:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505224704:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789302634.799810:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302634.799820:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.799839:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302634.799844:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.799855:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.799872:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.799881:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f12471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.799898:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302634.799900:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302634.799902:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789302634.799911:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302634.800156:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+20:11640:x1876219484271616:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 96202us (96625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302634.800165:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 226 00000100:00100000:2.0:1789302634.804477:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.804581:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484271744 00000100:00100000:0.0:1789302634.804591:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484271744 00000100:00100000:0.0:1789302634.804696:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:0.0:1789302634.804708:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+13:2351:x1876219484271744:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789302634.805178:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876219505224960:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302634.805205:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302634.807006:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.807131:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484271872 00000100:00100000:2.0:1789302634.807141:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484271872 00010000:00010000:2.0:1789302634.807186:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 14 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302634.807229:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:2.0:1789302634.807238:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+14:2352:x1876219484271872:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302634.807251:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302634.807257:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 14 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.807270:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 14 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.807646:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097ec5c44/0x20be524657f1222c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3938 expref: 14 pid: 6697 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.807662:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302634.807666:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789302634.807671:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.807680:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.807743:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302634.807865:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.807875:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.807886:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.807893:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.807911:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789302634.807991:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+13:2352:x1876219484271872:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 753us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302634.808009:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:3.0:1789302634.810152:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1876219505224576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11926us (12184us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789302634.810163:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1789302634.810201:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302634.810209:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.810221:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302634.810226:0:8459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.810236:0:8459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.810255:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.810264:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f1246a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.810282:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302634.810304:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302634.810306:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789302634.810357:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6935fddf80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789302634.810364:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505224576:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789302634.837444:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1789302634.837597:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1789302634.837608:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1789302634.837615:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1789302634.838115:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484271744:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 33402us (33642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302634.838130:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:0.0:1789302634.840906:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.840952:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484272128 00000100:00100000:2.0:1789302634.840962:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484272128 00000100:00100000:2.0:1789302634.841020:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 227 00000100:00100000:2.0:1789302634.841031:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+20:11640:x1876219484272128:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789302634.841090:0:6295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302634.841120:0:6295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8800/0x20be524657f12455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39cb expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.841138:0:6295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:2.0:1789302634.841144:0:6295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302634.841177:0:6295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.841191:0:6295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.841201:0:6295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302634.841631:0:6295:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c5e5c9a reply state 0000000040a80a3d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302634.841641:0:6295:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302634.842022:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+21:11640:x1876219484272128:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 798us (926us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789302634.842035:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 227 00010000:00010000:3.0:1789302634.844443:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.844475:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.844482:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.844488:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302634.844493:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.844500:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.844516:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:3.0:1789302634.844519:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302634.844524:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.844531:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12478 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6295 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.846025:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.846100:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484272256 00000100:00100000:3.0:1789302634.846110:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484272256 00000100:00100000:3.0:1789302634.846202:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789302634.846212:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484272256:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789302634.846509:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789302634.846513:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789302633 -> 1789302632 00002000:00010000:3.0:1789302634.846515:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789302632 00002000:00010000:3.0:1789302634.846518:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789302633 -> 1789302632 00002000:00010000:3.0:1789302634.846530:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789302634.846590:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484272256:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 379us (573us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789302634.846598:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:1.0:1789302634.849085:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.849275:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484272512 00000100:00100000:0.0:1789302634.849476:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484272512 00000100:00100000:0.0:1789302634.849576:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 228 00000100:00100000:0.0:1789302634.849587:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+20:11640:x1876219484272512:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789302634.849666:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.849682:0:9859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.849702:0:9859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.849734:0:9859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.849747:0:9859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 20 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.849761:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505225088:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302634.849860:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302634.853422:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302634.853631:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505225088:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302634.853659:0:9859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302634.853823:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484272640 00000100:00100000:2.0:1789302634.853840:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484272640 00010000:00010000:2.0:1789302634.853876:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 21 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302634.853914:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:2.0:1789302634.853923:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+21:2352:x1876219484272640:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302634.853938:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302634.853945:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 21 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.853957:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 21 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.853975:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6200/0x20be524657f12439 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39bd expref: 21 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.853992:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:2.0:1789302634.853997:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.854006:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.854014:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.854062:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302634.854118:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+20:2352:x1876219484272640:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 195us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302634.854125:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 83 00010000:00010000:1.0:1789302634.854313:0:9859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.854331:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.854359:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.854365:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.854371:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.854376:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302634.854380:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.854388:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.854410:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:1.0:1789302634.854413:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789302634.854417:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.854423:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f1247f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302634.854471:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+19:11640:x1876219484272512:12345-192.168.203.42@tcp:55:lhsmtool_posix.0 Request processed in 4886us (5394us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789302634.854479:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 228 00000100:00100000:0.0:1789302634.858895:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.858979:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484272768 00000100:00100000:3.0:1789302634.858989:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484272768 00000100:00100000:3.0:1789302634.859049:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:3.0:1789302634.859061:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:2353:x1876219484272768:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789302634.859114:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.859135:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.859144:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789302634.859149:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789302634.859154:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.859191:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.859207:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 8 pid: 6696 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302634.859223:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876219505225216:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302634.859571:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904f13480 going to sleep for 11 seconds 00000100:00100000:2.0:1789302634.863670:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.863777:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484272896 00000100:00100000:0.0:1789302634.863794:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484272896 00010000:00010000:0.0:1789302634.863861:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 9 pid: 6696 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.863902:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:0.0:1789302634.863911:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484272896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302634.863926:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302634.863951:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 9 pid: 6696 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.863966:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 9 pid: 6696 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.863993:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302634.863997:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302634.864004:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.864015:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.864037:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302634.864099:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+9:2351:x1876219484272896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 188us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302634.864107:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 84 00010000:00010000:3.0:1789302634.864907:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccb4bf38/0x20be524657f12463 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39d9 expref: 8 pid: 6696 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302634.864926:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6935d1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1876219505225216:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302634.864949:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.864959:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.864967:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.864994:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.865003:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.865011:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.865018:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7600 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302634.865023:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.865047:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.865061:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302634.865070:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a934ef39/0x20be524657f12486 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302634.865154:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+7:2353:x1876219484272768:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 6094us (6267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302634.865163:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:2.0:1789302634.867660:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.867722:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484273152 00000100:00100000:0.0:1789302634.867731:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484273152 00000100:00100000:0.0:1789302634.867795:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 229 00000100:00100000:0.0:1789302634.867819:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+19:11640:x1876219484273152:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789302634.867892:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.867908:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.867918:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.868137:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.868149:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 20 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.868157:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.868185:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 20 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.868196:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 20 pid: 6295 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.868207:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505225344:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302634.868380:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302634.871361:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.871616:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505225344:192.168.203.42@tcp:104: 00010000:00010000:0.0:1789302634.871647:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302634.871810:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484273280 00000100:00100000:2.0:1789302634.871817:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484273280 00010000:00010000:2.0:1789302634.871861:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 21 pid: 6295 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302634.871899:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:2.0:1789302634.871908:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+21:2351:x1876219484273280:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302634.871924:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302634.871930:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 21 pid: 6295 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.871941:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 21 pid: 6295 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.871961:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39c4 expref: 21 pid: 6295 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.871976:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:2.0:1789302634.871980:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.871999:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.872008:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.872088:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302634.872201:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+20:2351:x1876219484273280:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 294us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302634.872209:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 85 00010000:00010000:1.0:1789302634.872670:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.872679:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789302634.874074:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789302634.874231:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789302634.874272:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789302634.874535:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876219505225472:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789302634.874605:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302634.874645:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9480 going to sleep for 11 seconds 00000100:00100000:3.0:1789302634.874846:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505225472 00000100:00100000:3.0:1789302634.874854:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505225472 00000100:00100000:3.0:1789302634.874907:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789302634.874917:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1876219505225472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789302634.875008:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1876219505225472:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302634.875015:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302634.875249:0:5847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1789302634.875255:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1789302634.875272:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6935fde680, transno 4294967321 00000100:00100000:0.0:1789302634.875316:0:5847:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6935fddf80 x1876219505224576/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789302650 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302634.875332:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876219505225472:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789302634.875878:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789302634.875949:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876219505225600:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789302634.875991:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302634.876013:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302634.881421:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505225600 00000100:00100000:1.0:1789302634.881440:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505225600 00000100:00100000:1.0:1789302634.881491:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302634.881500:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1876219505225600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789302634.881777:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5847:x1876219505225600:12345-0@lo:1000:mdt00_002.0 Request processed in 277us (5784us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789302634.881812:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302634.882019:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1876219505225600:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789302634.882065:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882075:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882082:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882087:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302634.882092:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882100:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882116:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6904039d00) 00010000:00010000:0.0:1789302634.882128:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302634.882135:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882141:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12494 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882173:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882179:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882185:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882189:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302634.882192:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882197:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882204:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302634.882207:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789302634.882213:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a8 expref: 23 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882224:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a8 expref: 23 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882233:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a8 expref: 23 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.882273:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a8 expref: 23 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.882341:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505225728:192.168.203.42@tcp:105: 00000100:00100000:0.0:1789302634.882432:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789302634.887373:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1876219505225728:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789302634.887546:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887556:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f123d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887589:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887601:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887612:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887623:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887629:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887634:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887656:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302634.887660:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887667:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887679:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302634.887682:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302634.887685:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887690:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f1249b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887698:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887703:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887708:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887713:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302634.887715:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887720:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887739:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302634.887741:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789302634.887744:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.887749:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f1248d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.888151:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c72a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+23:11640:x1876219484273152:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 20332us (20495us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789302634.888161:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 229 00000020:00080000:0.0:1789302634.888167:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789302634.888904:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302634.888910:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789302634.888975:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302634.889485:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484273408 00000100:00100000:3.0:1789302634.889493:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484273408 00000100:00100000:3.0:1789302634.889541:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:3.0:1789302634.889550:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+23:11639:x1876219484273408:12345-192.168.203.42@tcp:49:lfs.0 00000100:00100000:3.0:1789302634.889666:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+23:11639:x1876219484273408:12345-192.168.203.42@tcp:49:lfs.0 Request processed in 116us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302634.889686:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000040:00080000:1.0:1789302634.891256:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789302634.891273:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302634.893947:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302634.893973:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505225856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302634.894046:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302634.894211:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505225856 00000100:00100000:2.0:1789302634.894221:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505225856 00000100:00100000:2.0:1789302634.894277:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789302634.894310:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505225856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302634.894349:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302634.894416:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505225856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302634.894424:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789302634.894629:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505225856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302634.895826:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.895876:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302634.895974:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484273664 00000100:00100000:1.0:1789302634.895982:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484273664 00000100:00100000:1.0:1789302634.896039:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 230 00000100:00100000:1.0:1789302634.896049:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+23:11639:x1876219484273664:12345-192.168.203.42@tcp:58:lfs.0 00000040:00080000:1.0:1789302634.896467:0:6295:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789302634.896553:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+23:11639:x1876219484273664:12345-192.168.203.42@tcp:58:lfs.0 Request processed in 504us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302634.896561:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 230 00000100:00100000:3.0:1789302634.900053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484273920 00000100:00100000:3.0:1789302634.900067:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484273920 00000100:00100000:2.0:1789302634.900322:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:2.0:1789302634.900332:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6904984050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+23:11640:x1876219484273920:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789302634.901057:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789302634.901178:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1789302634.901225:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.901248:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.901260:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.901268:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.901274:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.901279:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302634.901323:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789302634.901416:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6904984050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+25:11640:x1876219484273920:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 1083us (5536us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789302634.901423:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000020:00080000:2.0:1789302634.901429:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789302634.903245:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302634.903258:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.903268:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302634.903273:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.903283:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.903333:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6907c68e00) 00010000:00010000:1.0:1789302634.903336:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789302634.903356:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.903363:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8c00/0x20be524657f124a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.903396:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302634.903398:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302634.903400:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302634.943188:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.943526:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484274048 00000100:00100000:0.0:1789302634.943536:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484274048 00000100:00100000:0.0:1789302634.943599:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 231 00000100:00100000:0.0:1789302634.943609:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+25:11642:x1876219484274048:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302634.943633:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302634.943653:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f124a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39e0 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.943716:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.943730:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.943758:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.943774:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.943781:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.943799:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.944055:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.944066:0:9859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.944074:0:9859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.944124:0:9859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.944137:0:9859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 26 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.944149:0:9859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505225984:192.168.203.42@tcp:104: 00000100:00100000:0.0:1789302634.944242:0:9859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909d1fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302634.951073:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302634.951169:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484274304 00000100:00100000:2.0:1789302634.951179:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484274304 00000100:00100000:2.0:1789302634.951237:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:2.0:1789302634.951248:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+27:5591:x1876219484274304:12345-192.168.203.42@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789302634.951652:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+28:5591:x1876219484274304:12345-192.168.203.42@tcp:35:ldlm_bl.0 Request processed in 404us (587us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789302634.951660:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 63 00000100:00100000:1.0:1789302634.951772:0:9859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9859:1876219505225984:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302634.951807:0:9859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302634.955188:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302634.955456:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484274432 00000100:00100000:0.0:1789302634.955466:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484274432 00010000:00010000:0.0:1789302634.955507:0:6712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 28 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302634.955545:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:0.0:1789302634.955554:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+28:2351:x1876219484274432:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302634.955569:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302634.955575:0:6712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 28 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.955588:0:6712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 28 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.955608:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9c00/0x20be524657f123c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a1 expref: 28 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.955624:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302634.955629:0:6712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.955639:0:6712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.955647:0:6712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302634.955675:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302634.955960:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ace2f696-3715-4928-b36c-02db3411d1a3+27:2351:x1876219484274432:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 405us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302634.955969:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 86 00010000:00010000:1.0:1789302634.956078:0:9859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956087:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302634.956144:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789302634.956149:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302634.956170:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956182:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956191:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956198:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956213:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956219:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302634.956223:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956231:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956241:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:1.0:1789302634.956244:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302634.956248:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956254:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f124b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956267:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956273:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956279:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956620:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302634.956625:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956643:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956652:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a69061a7200) 00010000:00010000:1.0:1789302634.956654:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302634.956657:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956663:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f124b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956814:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f124a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39e0 expref: 27 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956902:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39e0 expref: 26 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302634.956910:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:1.0:1789302634.956912:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302634.956914:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9200, rc 0) 00000100:00100000:0.0:1789302634.957006:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+26:11642:x1876219484274048:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 13397us (13826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302634.957014:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 231 00000100:00100000:0.0:1789302635.408247:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505226112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302635.408343:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302635.408415:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505226112 00000100:00100000:0.0:1789302635.408424:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505226112 00000100:00100000:0.0:1789302635.408471:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789302635.408481:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505226112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302635.408503:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789302635.408548:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505226112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302635.408556:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789302635.409070:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505226112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302635.412691:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505226368:0@lo:400:kworker.0 00000100:00100000:1.0:1789302635.412766:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302635.412950:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505226240:0@lo:400:kworker.0 00000100:00100000:0.0:1789302635.412987:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302635.413033:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302635.413040:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505226624:0@lo:400:kworker.0 00000100:00100000:0.0:1789302635.413078:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302635.413107:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505226368 00000100:00100000:0.0:1789302635.413115:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505226368 00000100:00100000:0.0:1789302635.413156:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505226624 00000100:00100000:0.0:1789302635.413159:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505226624 00000100:00100000:0.0:1789302635.413215:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789302635.413224:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505226368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302635.413270:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505226368:12345-0@lo:400:kworker.0 Request processed in 48us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302635.413277:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789302635.413313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789302635.413320:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505226624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302635.413352:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876219505226624:12345-0@lo:400:kworker.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302635.413358:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789302635.413375:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505226240 00000100:00100000:0.0:1789302635.413379:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505226240 00000100:00100000:0.0:1789302635.413405:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789302635.413412:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505226240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302635.413442:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505226240:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302635.413449:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1789302635.413474:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302635.413507:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1876219505226624:0@lo:400:kworker.0 00000100:00100000:0.0:1789302635.413517:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505226240:0@lo:400:kworker.0 00000100:00100000:1.0:1789302635.416015:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505226368:0@lo:400:kworker.0 00000100:00100000:1.0:1789302635.416061:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302635.416074:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505226496:0@lo:400:kworker.0 00000100:00100000:1.0:1789302635.416132:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302635.416184:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505226496 00000100:00100000:1.0:1789302635.416199:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505226496 00000100:00100000:1.0:1789302635.416262:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789302635.416271:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505226496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302635.416353:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505226496:12345-0@lo:400:kworker.0 Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302635.416360:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789302635.416393:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505226496:0@lo:400:kworker.0 00000100:00080000:0.0:1789302635.416511:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789302635.598485:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789302635.817736:0:12627:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789302635.817749:0:12627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789302635.817831:0:12627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789302635.817840:0:12627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789302635.922340:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302635.922357:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789302635.922422:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789302635.922429:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789302635.922579:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505226752:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789302635.922687:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805eaa840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302635.929469:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302635.931193:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484274560 00000100:00100000:1.0:1789302635.931213:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484274560 00000100:00100000:1.0:1789302635.931428:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 232 00000100:00100000:1.0:1789302635.931443:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+27:11654:x1876219484274560:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789302635.931492:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789302635.931640:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ace2f696-3715-4928-b36c-02db3411d1a3+27:11654:x1876219484274560:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 201us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302635.931649:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 232 00000100:00100000:2.0:1789302635.938992:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302635.939452:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1876219505226752:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789302635.939822:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484274816 00000100:00100000:0.0:1789302635.939839:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484274816 00000100:00100000:0.0:1789302635.939932:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 233 00000100:00100000:0.0:1789302635.939945:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+26:11654:x1876219484274816:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789302635.939988:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302635.940015:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39e7 expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.940956:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9e00/0x20be524657f124cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.940978:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9e00/0x20be524657f124cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.940996:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9e00/0x20be524657f124cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302635.941010:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789302635.942000:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39e7 expref: 29 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.942519:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9e00/0x20be524657f124cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39e7 expref: 28 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.942533:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302635.942537:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789302635.942542:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9e00, rc 0) 00000100:00100000:0.0:1789302635.942660:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+28:11654:x1876219484274816:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 2716us (3674us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789302635.942672:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 233 00000100:00100000:0.0:1789302635.950528:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302635.950663:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302635.950711:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484274944 00000100:00100000:0.0:1789302635.950740:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484274944 00000100:00100000:0.0:1789302635.950842:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789302635.950858:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+28:2351:x1876219484274944:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302635.950879:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302635.950915:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9e00/0x20be524657f124cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39e7 expref: 28 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.950940:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302635.950947:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302635.951015:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ace2f696-3715-4928-b36c-02db3411d1a3+27:2351:x1876219484274944:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 162us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302635.951023:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:0.0:1789302635.951056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484275200 00000100:00100000:0.0:1789302635.951061:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484275200 00000100:00100000:0.0:1789302635.951255:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 234 00000100:00100000:0.0:1789302635.951265:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+27:11654:x1876219484275200:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789302635.951589:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951610:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951625:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951883:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951893:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951909:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951916:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302635.951922:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951931:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951941:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302635.951945:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789302635.951950:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302635.951957:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f124da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302635.952472:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+28:11654:x1876219484275200:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 1204us (1803us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789302635.952484:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 234 00000100:00100000:3.0:1789302635.954758:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302635.954808:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484275456 00000100:00100000:3.0:1789302635.954818:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484275456 00000100:00100000:3.0:1789302635.954870:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 64 00000100:00100000:3.0:1789302635.954880:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+28:11654:x1876219484275456:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1789302635.955489:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302635.955499:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789302635.955765:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+29:11654:x1876219484275456:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 883us (1012us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789302635.955774:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 64 00000040:00080000:0.0:1789302635.956062:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789302635.956073:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1789302636.014078:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1789302636.014094:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1789302636.014104:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:3.0:1789302636.621673:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302637.645539:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302637.759052:0:12682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789302637.759065:0:12682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302637.759120:0:12682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789302637.759126:0:12682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789302638.014232:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302638.014334:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484275712 00000100:00100000:2.0:1789302638.014349:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484275712 00000100:00080000:0.0:1789302638.014436:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302638.014447:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 235 00000100:00100000:2.0:1789302638.014462:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+29:11675:x1876219484275712:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302638.014497:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302638.014525:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f124e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39ee expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302638.014670:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f124e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302638.014689:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f124e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302638.014706:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f124e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302638.014721:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789302638.014899:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f124e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39ee expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302638.014939:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f124e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39ee expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302638.014948:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:2.0:1789302638.014951:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789302638.014956:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8200, rc 0) 00000100:00100000:2.0:1789302638.015040:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+31:11675:x1876219484275712:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 582us (832us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789302638.015049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 235 00000100:00100000:2.0:1789302638.018826:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302638.018915:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484275840 00000100:00100000:0.0:1789302638.018928:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484275840 00000100:00100000:0.0:1789302638.019006:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 236 00000100:00100000:0.0:1789302638.019019:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+31:11675:x1876219484275840:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:0.0:1789302638.019125:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019148:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019163:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019212:0:9859:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019220:0:9859:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019228:0:9859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019234:0:9859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302638.019239:0:9859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019248:0:9859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019262:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:0.0:1789302638.019324:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302638.019332:0:9859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302638.019339:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8600/0x20be524657f124f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302638.019436:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ace2f696-3715-4928-b36c-02db3411d1a3+31:11675:x1876219484275840:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 418us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302638.019445:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 236 00000100:00100000:3.0:1789302638.107476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302638.109958:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484275968 00000100:00100000:2.0:1789302638.109980:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484275968 00000100:00100000:2.0:1789302638.110100:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:2.0:1789302638.110118:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484275968:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:2.0:1789302638.110143:0:10693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302638.110170:0:10693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d4fe160/0x20be524657f124fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39f5 expref: -99 pid: 10693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302638.110209:0:10693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa69768, atime: 0x6aa69768, ctime: 0x6aa69768, blocks: 0xb 00010000:00010000:2.0:1789302638.110240:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1789302638.110245:0:10693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302638.110256:0:10693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d4fe160/0x20be524657f124fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39f5 expref: 8 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302638.110278:0:10693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007d4fe160/0x20be524657f124fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39f5 expref: 8 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302638.110357:0:10693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8e00, rc 0) 00000100:00100000:2.0:1789302638.110447:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484275968:12345-192.168.203.42@tcp:101:cat.0 Request processed in 336us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302638.110455:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00080000:0.0:1789302638.110673:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302638.117393:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302638.117503:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484276096 00000100:00100000:1.0:1789302638.117517:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484276096 00002000:00100000:1.0:1789302638.117597:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9a6936c53b80 x1876219484276096/t0(0) o3->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:214/0 lens 488/0 e 0 to 0 dl 1789302649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302638.117611:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936c53b80 with x1876219484276096 ext(0->4095) 00002000:00010000:1.0:1789302638.117619:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6936c53b80 00000100:00100000:1.0:1789302638.117658:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789302638.117670:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484276096:12345-192.168.203.42@tcp:3:cat.0 00000100:00100000:1.0:1789302638.118062:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ace2f696-3715-4928-b36c-02db3411d1a3+8:2351:x1876219484276096:12345-192.168.203.42@tcp:3:cat.0 Request processed in 392us (692us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789302638.118092:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00002000:00100000:1.0:1789302638.118100:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9a6936c53b80 x1876219484276096/t0(0) o3->ace2f696-3715-4928-b36c-02db3411d1a3@192.168.203.42@tcp:214/0 lens 488/4536 e 0 to 0 dl 1789302649 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789302638.118109:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6936c53b80 with x1876219484276096 ext(0->4095) 00002000:00010000:1.0:1789302638.118129:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6936c53b80 00000100:00100000:3.0:1789302638.445206:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302638.445259:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302638.445344:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302638.445451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302638.445522:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484276480 00000100:00100000:0.0:1789302638.445536:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484276480 00000100:00100000:0.0:1789302638.445614:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:0.0:1789302638.445626:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484276480:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302638.446266:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484276480:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 637us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302638.446277:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00080000:0.0:1789302638.446368:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789302638.446975:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484276224 00000100:00100000:1.0:1789302638.446985:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484276224 00000100:00100000:1.0:1789302638.447048:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 298 00000100:00100000:1.0:1789302638.447059:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484276224:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302638.447130:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484276224:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 73us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302638.447137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 298 00000100:00100000:3.0:1789302638.451553:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302638.451913:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484276608 00000100:00100000:0.0:1789302638.451928:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484276608 00000100:00100000:0.0:1789302638.452004:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:0.0:1789302638.452017:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484276608:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302638.452127:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+8:2352:x1876219484276608:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 112us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302638.452136:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:2.0:1789302638.454360:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484276736 00000100:00100000:2.0:1789302638.454383:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484276736 00000100:00100000:2.0:1789302638.454553:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484276352 00000100:00100000:2.0:1789302638.454558:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484276352 00000100:00100000:1.0:1789302638.454642:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 160 00000100:00100000:1.0:1789302638.454658:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484276736:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302638.454775:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2352:x1876219484276736:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 121us (9430us total) trans 0 rc 0/0 00000100:00080000:0.0:1789302638.454782:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302638.454786:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 160 00000100:00100000:1.0:1789302638.454815:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 161 00000100:00100000:1.0:1789302638.454822:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+31:2352:x1876219484276352:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302638.454852:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+31:2352:x1876219484276352:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 31us (9402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302638.454858:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 161 00010000:00010000:3.0:1789302638.669570:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789302639.053998:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789302639.054013:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789302639.054053:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789302639.054061:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789302639.693494:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302640.013811:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505226880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302640.013927:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302640.014687:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505226880 00000100:00100000:2.0:1789302640.014700:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505226880 00000100:00100000:2.0:1789302640.014785:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789302640.014797:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505226880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302640.014840:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789302640.014854:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302640.014912:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505226880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302640.014919:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789302640.014968:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789302640.014976:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789302640.014999:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6935fdea00, transno 4294967310 00000100:00100000:2.0:1789302640.015093:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505226880:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789302640.116110:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1789302640.116147:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789302640.119935:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1789302640.119964:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6909d1f6c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789302640.119987:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a693c2ca100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6909d1fcc0 00000020:00080000:3.0:1789302640.119991:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a693c2cae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6936059800 00000001:00080000:3.0:1789302640.120032:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1789302640.120060:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789302640.120254:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789302640.120615:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1789302640.525563:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505227392:0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.525563:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505227264:0@lo:400:kworker.0 00000100:00100000:3.0:1789302640.525642:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505227008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302640.525898:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302640.525982:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505227136:0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.526017:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302640.526040:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505227648:0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.526083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302640.526125:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505227264 00000100:00100000:0.0:1789302640.526134:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505227264 00000100:00100000:0.0:1789302640.526189:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789302640.526200:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505227264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.526283:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505227264:12345-0@lo:400:kworker.0 Request processed in 84us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302640.526311:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789302640.526338:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505227136 00000100:00100000:0.0:1789302640.526342:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505227136 00000100:00100000:0.0:1789302640.526371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789302640.526378:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505227136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.526583:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505227136:12345-0@lo:400:kworker.0 Request processed in 204us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302640.526590:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789302640.526625:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505227648 00000100:00100000:0.0:1789302640.526630:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505227648 00000100:00100000:0.0:1789302640.526691:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302640.526698:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505227648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.526809:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505227648:12345-0@lo:400:kworker.0 Request processed in 35us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302640.526823:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789302640.526867:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505227136:0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.526879:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789302640.526885:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6935fddf80, transno 4294967322 00000004:00080000:0.0:1789302640.526896:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1789302640.526921:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505227648:0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.526946:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505227264:0@lo:400:kworker.0 00000100:00100000:1.0:1789302640.536367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302640.536498:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505227392 00000100:00100000:0.0:1789302640.536512:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505227392 00000100:00100000:0.0:1789302640.536596:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789302640.536610:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505227392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.536716:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505227392:12345-0@lo:400:kworker.0 Request processed in 110us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302640.536724:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789302640.537145:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505227392:0@lo:400:kworker.0 00000100:00100000:3.0:1789302640.538385:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302640.538450:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505227520:0@lo:400:kworker.0 00000100:00100000:0.0:1789302640.538481:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505227008 00000100:00100000:0.0:1789302640.538491:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505227008 00000100:00100000:3.0:1789302640.538495:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302640.538531:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505227520 00000100:00100000:3.0:1789302640.538536:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505227520 00000100:00100000:0.0:1789302640.538551:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302640.538562:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505227008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302640.538582:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789302640.538593:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505227520:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789302640.538608:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789302640.543774:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302640.543788:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302640.545898:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505227008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7329us (7510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302640.545915:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789302640.546401:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505227520:12345-0@lo:400:kworker.0 Request processed in 7806us (7904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302640.547283:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789302640.548320:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505227520:0@lo:400:kworker.0 00000100:00100000:3.0:1789302640.549879:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505227008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789302640.718463:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302641.741620:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302642.765974:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302642.977218:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302642.977378:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484276864 00000100:00100000:1.0:1789302642.977391:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484276864 00000100:00100000:1.0:1789302642.977477:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 237 00000100:00100000:1.0:1789302642.977490:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6935fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+18:11319:x1876219484276864:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789302642.977627:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6935fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+18:11319:x1876219484276864:12345-192.168.203.42@tcp:60:lhsmtool_posix.0 Request processed in 140us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302642.977634:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 237 00000100:00080000:2.0:1789302642.987087:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302643.000924:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302643.001010:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484277120 00000100:00100000:2.0:1789302643.001024:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484277120 00000100:00100000:2.0:1789302643.001097:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:2.0:1789302643.001109:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:11319:x1876219484277120:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789302643.001586:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+19:11319:x1876219484277120:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 477us (675us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789302643.001607:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 65 00000100:00100000:1.0:1789302643.563632:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302643.563678:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302643.563716:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302643.563754:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302643.563796:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302643.563973:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484277504 00000100:00100000:3.0:1789302643.563988:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484277504 00000100:00100000:3.0:1789302643.564070:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484277632 00000100:00100000:3.0:1789302643.564074:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484277632 00000100:00100000:3.0:1789302643.564113:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:3.0:1789302643.564126:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2351:x1876219484277504:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302643.564219:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+5:2351:x1876219484277504:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 95us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302643.564246:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:3.0:1789302643.564269:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789302643.564276:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484277632:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302643.564372:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ace2f696-3715-4928-b36c-02db3411d1a3+7:2351:x1876219484277632:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 95us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302643.564378:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:3.0:1789302643.564400:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484277760 00000100:00100000:3.0:1789302643.564404:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484277760 00000100:00100000:3.0:1789302643.564434:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484277376 00000100:00100000:3.0:1789302643.564438:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484277376 00000100:00100000:3.0:1789302643.564459:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 165 00000100:00100000:3.0:1789302643.564467:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484277760:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302643.564499:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2351:x1876219484277760:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 33us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302643.564505:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 165 00000100:00100000:3.0:1789302643.564518:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00100000:3.0:1789302643.564525:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+19:2351:x1876219484277376:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302643.564559:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ace2f696-3715-4928-b36c-02db3411d1a3+19:2351:x1876219484277376:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 34us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302643.564565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 166 00000100:00080000:1.0:1789302643.564877:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789302643.564882:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789302643.564884:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302643.565506:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484277248 00000100:00100000:0.0:1789302643.565516:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484277248 00000100:00100000:0.0:1789302643.565574:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 300 00000100:00100000:0.0:1789302643.565599:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484277248:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302643.565663:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2351:x1876219484277248:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 67us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302643.565671:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 300 00010000:00010000:1.0:1789302643.790041:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302644.814433:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789302644.915712:0:12884:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:30:42 (1789302642) 00000100:00100000:3.0:1789302645.136190:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505227776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302645.136325:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302645.136370:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505227776 00000100:00100000:2.0:1789302645.136381:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505227776 00000100:00100000:2.0:1789302645.136452:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789302645.136462:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505227776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302645.136505:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302645.136563:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505227776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302645.136571:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789302645.136609:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302645.137314:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505227776:0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1789302645.195744:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1789302645.198198:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789302645.198362:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789302645.198376:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1789302645.645901:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505227904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302645.645998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302645.646153:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505227904 00000100:00100000:1.0:1789302645.646165:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505227904 00000100:00100000:1.0:1789302645.646247:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789302645.646260:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505227904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302645.646342:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302645.646412:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505227904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302645.646420:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789302645.646675:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505228160:0@lo:400:kworker.0 00000100:00100000:2.0:1789302645.646728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302645.646756:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302645.646762:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505228032:0@lo:400:kworker.0 00000100:00100000:2.0:1789302645.646793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302645.646841:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505228032 00000100:00100000:2.0:1789302645.646847:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505228032 00000100:00100000:2.0:1789302645.646881:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789302645.646889:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505228032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302645.646929:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3306:x1876219505228032:12345-0@lo:400:kworker.0 Request processed in 40us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302645.646935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789302645.646987:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c76f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505228032:0@lo:400:kworker.0 00000100:00080000:3.0:1789302645.647125:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302645.647141:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505228160 00000100:00100000:3.0:1789302645.647145:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505228160 00000100:00100000:3.0:1789302645.647187:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789302645.647195:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505228160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302645.647240:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505228160:12345-0@lo:400:kworker.0 Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302645.647246:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789302645.647266:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505228288:0@lo:400:kworker.0 00000100:00100000:3.0:1789302645.647331:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302645.647356:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302645.647362:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505228416:0@lo:400:kworker.0 00000100:00100000:3.0:1789302645.647397:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302645.647423:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505228288 00000100:00100000:3.0:1789302645.647428:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505228288 00000100:00100000:3.0:1789302645.647459:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505228416 00000100:00100000:3.0:1789302645.647462:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505228416 00000100:00100000:3.0:1789302645.647480:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789302645.647486:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505228288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302645.647521:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505228288:12345-0@lo:400:kworker.0 Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302645.647527:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789302645.647547:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789302645.647553:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505228416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302645.647594:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505228416:12345-0@lo:400:kworker.0 Request processed in 41us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302645.647601:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1789302645.647631:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302645.647653:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505228416:0@lo:400:kworker.0 00000100:00100000:3.0:1789302645.647663:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505228288:0@lo:400:kworker.0 00000100:00100000:3.0:1789302645.647686:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505228160:0@lo:400:kworker.0 00000100:00100000:3.0:1789302645.647728:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505227904:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789302645.837483:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302646.861547:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302647.381255:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302647.381766:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484277888 00000100:00100000:3.0:1789302647.381780:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484277888 00000100:00100000:3.0:1789302647.381884:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 238 00000100:00100000:3.0:1789302647.381897:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:12340:x1876219484277888:12345-192.168.203.42@tcp:101:lsof.0 00010000:00010000:3.0:1789302647.381924:0:9859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302647.381954:0:9859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b39fc expref: -99 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302647.382035:0:9859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1250b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302647.382051:0:9859:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302647.382065:0:9859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302647.382132:0:9859:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789302647.382137:0:9859:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302647.382188:0:9859:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302647.382219:0:9859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7600/0x20be524657f12504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39fc expref: 7 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302647.382242:0:9859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1250b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39fc expref: 6 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302647.382251:0:9859:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:3.0:1789302647.382254:0:9859:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302647.382259:0:9859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7200, rc 0) 00000100:00100000:3.0:1789302647.382389:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:12340:x1876219484277888:12345-192.168.203.42@tcp:101:lsof.0 Request processed in 495us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302647.382396:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 238 00000100:00080000:0.0:1789302647.383153:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302647.887225:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302648.684279:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302648.684467:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302648.684508:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302648.684533:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302648.684559:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302648.684593:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484278528 00000100:00100000:3.0:1789302648.684607:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484278528 00000100:00100000:3.0:1789302648.684673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484278144 00000100:00100000:3.0:1789302648.684677:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484278144 00000100:00100000:3.0:1789302648.684725:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:3.0:1789302648.684755:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:2352:x1876219484278528:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302648.684849:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:2352:x1876219484278528:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 97us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302648.684858:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 170 00000100:00100000:3.0:1789302648.684879:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:3.0:1789302648.684886:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:2352:x1876219484278144:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302648.684913:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:2352:x1876219484278144:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302648.684919:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 171 00000100:00100000:3.0:1789302648.684944:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484278272 00000100:00100000:3.0:1789302648.684948:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484278272 00000100:00100000:3.0:1789302648.684976:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484278400 00000100:00100000:3.0:1789302648.684978:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484278400 00000100:00100000:3.0:1789302648.684999:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:3.0:1789302648.685006:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484278272:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302648.685032:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+5:2352:x1876219484278272:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302648.685038:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 70 00000100:00100000:3.0:1789302648.685051:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00100000:3.0:1789302648.685057:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484278400:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302648.685084:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2352:x1876219484278400:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302648.685090:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 71 00000100:00080000:3.0:1789302648.685358:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302648.685371:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302648.685373:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302648.685918:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484278016 00000100:00100000:0.0:1789302648.685925:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484278016 00000100:00100000:0.0:1789302648.685978:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 302 00000100:00100000:0.0:1789302648.685987:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484278016:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302648.686031:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2352:x1876219484278016:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 45us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302648.686037:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 302 00000100:00100000:3.0:1789302648.795768:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302648.796083:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484278784 00000100:00100000:2.0:1789302648.796097:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484278784 00000100:00100000:2.0:1789302648.796170:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:2.0:1789302648.796183:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+18:12341:x1876219484278784:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:2.0:1789302648.796706:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+19:12341:x1876219484278784:12345-192.168.203.42@tcp:35:umount.0 Request processed in 524us (950us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789302648.796714:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 66 00000100:00100000:0.0:1789302648.799647:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302648.799885:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484279040 00000100:00100000:2.0:1789302648.799900:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484279040 00000100:00100000:2.0:1789302648.799971:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:2.0:1789302648.799984:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+19:12341:x1876219484279040:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:2.0:1789302648.802182:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ace2f696-3715-4928-b36c-02db3411d1a3+20:12341:x1876219484279040:12345-192.168.203.42@tcp:35:umount.0 Request processed in 2185us (2533us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789302648.802198:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 67 00000100:00100000:3.0:1789302648.804431:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302648.804636:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484279296 00000100:00100000:0.0:1789302648.804649:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484279296 00000100:00100000:0.0:1789302648.804727:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:0.0:1789302648.804739:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6904986850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+20:12341:x1876219484279296:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:0.0:1789302648.805121:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6904986850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+21:12341:x1876219484279296:12345-192.168.203.42@tcp:35:umount.0 Request processed in 383us (701us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789302648.805130:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 68 00000100:00100000:3.0:1789302648.811116:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302648.813650:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484279552 00000100:00100000:0.0:1789302648.813669:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484279552 00000100:00100000:0.0:1789302648.814050:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:0.0:1789302648.814080:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+21:12341:x1876219484279552:12345-192.168.203.42@tcp:35:umount.0 00000100:00100000:0.0:1789302648.814996:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ace2f696-3715-4928-b36c-02db3411d1a3+22:12341:x1876219484279552:12345-192.168.203.42@tcp:35:umount.0 Request processed in 913us (3888us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789302648.815007:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 69 00000100:00100000:1.0:1789302648.824423:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302648.824474:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302648.824510:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302648.824544:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302648.824670:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484280064 00000100:00100000:2.0:1789302648.824685:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484280064 00000100:00100000:2.0:1789302648.824786:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484280320 00000100:00100000:2.0:1789302648.824790:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484280320 00000100:00100000:2.0:1789302648.824828:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484280192 00000100:00100000:2.0:1789302648.824831:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484280192 00000100:00100000:2.0:1789302648.824850:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:2.0:1789302648.824863:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+15:2354:x1876219484280064:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302648.824882:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302648.824921:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7400/0x20be524657f11591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b358e expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302648.824951:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302648.825023:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+14:2354:x1876219484280064:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 163us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302648.825031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:2.0:1789302648.825060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:2.0:1789302648.825067:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+13:2354:x1876219484280320:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302648.825075:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302648.825085:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6942044400/0x20be524657f1177b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3659 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302648.825095:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302648.825126:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:2354:x1876219484280320:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 48us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302648.825134:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:2.0:1789302648.825147:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:2.0:1789302648.825153:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:2354:x1876219484280192:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302648.825161:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302648.825169:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6900031800/0x20be524657f114f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3556 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302648.825187:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302648.825207:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2354:x1876219484280192:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 54us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302648.825215:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:3.0:1789302648.826533:0:10693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484279936 00000100:00100000:3.0:1789302648.826550:0:10693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484279936 00000100:00100000:3.0:1789302648.826619:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:3.0:1789302648.826630:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+7:2350:x1876219484279936:12345-192.168.203.42@tcp:9:umount.0 00000020:00000080:3.0:1789302648.826667:0:10693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11ad1 00000020:00010000:3.0:1789302648.826677:0:10693:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a6906135800: total 0 00000100:00080000:3.0:1789302648.826684:0:10693:0:(import.c:65:import_set_state_nolock()) ffff9a6906134800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789302648.826764:0:10693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1789302648.827445:0:8459:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a6906135800: total 0 00010000:00010000:0.0:1789302648.827490:0:8459:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6906135800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789302648.827557:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d4fe160/0x20be524657f124fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39f5 expref: 7 pid: 10693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302648.827598:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcfdb2c0/0x20be524657f11e6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b382e expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302648.827613:0:8459:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6906135800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789302648.827625:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302648.827628:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302648.827630:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302648.830764:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ace2f696-3715-4928-b36c-02db3411d1a3+2:2350:x1876219484279936:12345-192.168.203.42@tcp:9:umount.0 Request processed in 4118us (6341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302648.830782:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 72 00000100:00100000:1.0:1789302648.841049:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302648.843205:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484280448 00000100:00100000:3.0:1789302648.843226:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484280448 00000100:00100000:3.0:1789302648.843331:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:3.0:1789302648.843346:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+5:2350:x1876219484280448:12345-192.168.203.42@tcp:9:umount.0 00000020:00000080:3.0:1789302648.843395:0:6699:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11869 00000100:00080000:3.0:1789302648.843409:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9a6906127800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789302648.843456:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789302648.843468:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789302648.843900:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ace2f696-3715-4928-b36c-02db3411d1a3+2:2350:x1876219484280448:12345-192.168.203.42@tcp:9:umount.0 Request processed in 556us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302648.843910:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 73 00000100:00100000:1.0:1789302648.851746:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302648.852276:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484281472 00000100:00100000:3.0:1789302648.852345:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484281472 00000100:00100000:3.0:1789302648.852435:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 239 00000100:00100000:3.0:1789302648.852448:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+22:2350:x1876219484281472:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:3.0:1789302648.852507:0:6295:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11505 00000020:00010000:3.0:1789302648.852528:0:6295:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a6805803800: total 0 00000100:00080000:3.0:1789302648.852534:0:6295:0:(import.c:65:import_set_state_nolock()) ffff9a69369ed800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789302648.852574:0:6295:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1789302648.853048:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ace2f696-3715-4928-b36c-02db3411d1a3+21:2350:x1876219484281472:12345-192.168.203.42@tcp:39:umount.0 Request processed in 601us (1317us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789302648.853058:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 239 00000020:00010000:1.0:1789302648.853255:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a6805803800: total 0 00010000:00010000:1.0:1789302648.853339:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6805803800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789302648.853383:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:1.0:1789302648.853388:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789302648.853399:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f11e58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3827 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853423:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:1.0:1789302648.853426:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302648.853431:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69421c9600/0x20be524657f11e2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3819 expref: 19 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853446:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:1.0:1789302648.853449:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302648.853453:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8a00/0x20be524657f117cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3667 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853489:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:1.0:1789302648.853492:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302648.853496:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9200/0x20be524657f124be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39e0 expref: 17 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853510:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:1.0:1789302648.853513:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302648.853517:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f11ec1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3843 expref: 16 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853531:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:1.0:1789302648.853534:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789302648.853538:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6000/0x20be524657f11b2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3755 expref: 15 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853551:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a69061a7900) 00010000:00010000:1.0:1789302648.853553:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302648.853557:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f11d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b37e1 expref: 14 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853574:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:1.0:1789302648.853576:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789302648.853580:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f121bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b391c expref: 13 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853592:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6907c68300) 00010000:00010000:1.0:1789302648.853594:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789302648.853604:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f1183f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3683 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853622:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:1.0:1789302648.853624:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789302648.853628:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8200/0x20be524657f124e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39ee expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853640:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6907c68100) 00010000:00010000:1.0:1789302648.853642:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302648.853646:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f123de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39a8 expref: 10 pid: 6295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853660:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a69061a7700) 00010000:00010000:1.0:1789302648.853662:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789302648.853665:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f11edd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b384a expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853681:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6904039500) 00010000:00010000:1.0:1789302648.853684:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302648.853699:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f117eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b366e expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302648.853716:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6805803800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789302648.853730:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302648.853732:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302648.853734:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302648.910128:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789302649.298082:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789302649.298095:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302649.299043:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789302649.299054:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789302649.933616:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302650.265415:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505228544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789302650.265501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302650.265585:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505228544 00000100:00100000:0.0:1789302650.265594:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505228544 00000100:00100000:0.0:1789302650.265653:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789302650.265664:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505228544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302650.265713:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302650.265770:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505228544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302650.265778:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789302650.272062:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302650.272161:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505228544:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789302650.348672:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:1.0:1789302650.348717:0:7652:0:(genops.c:885:class_export_put()) final put ffff9a6906135800/ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:2.0:1789302650.348789:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6906135800/ace2f696-3715-4928-b36c-02db3411d1a3 for lustre-OST0001 00000020:00000080:2.0:1789302650.348857:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6906134800 for lustre-OST0001 00000001:00080000:1.0:1789302650.349563:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1789302650.349588:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000001:00080000:1.0:1789302650.349603:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789302650.349607:0:5867:0:(genops.c:885:class_export_put()) final put ffff9a6805803800/ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:3.0:1789302650.349708:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6805803800/ace2f696-3715-4928-b36c-02db3411d1a3 for lustre-MDT0000 00000020:00000080:3.0:1789302650.349925:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a69369ed800 for lustre-MDT0000 00000100:00100000:1.0:1789302650.493633:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302650.493821:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302650.495567:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302650.495906:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484281728 00000100:00100000:2.0:1789302650.495920:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484281728 00000100:00100000:2.0:1789302650.496054:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484281600 00000100:00100000:2.0:1789302650.496058:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484281600 00000100:00100000:1.0:1789302650.496514:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302650.496883:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484281856 00000100:00100000:0.0:1789302650.496889:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484281856 00000100:00100000:0.0:1789302650.496926:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789302650.496937:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+12:2354:x1876219484281728:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302650.496957:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302650.496981:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6942045a00/0x20be524657f115de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35cd expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302650.497003:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302650.497069:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+11:2354:x1876219484281728:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 133us (3512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302650.497076:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789302650.497094:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:0.0:1789302650.497101:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+10:2354:x1876219484281600:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302650.497109:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302650.497118:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abe000/0x20be524657f115d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b35a3 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302650.497128:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302650.497146:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+9:2354:x1876219484281600:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 46us (3326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302650.497152:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:0.0:1789302650.497185:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:0.0:1789302650.497192:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+8:2354:x1876219484281856:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302650.497199:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302650.497208:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6942044a00/0x20be524657f11774 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3652 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302650.497217:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302650.497237:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+7:2354:x1876219484281856:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 46us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302650.497243:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:0.0:1789302650.497605:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484282112 00000100:00100000:0.0:1789302650.497611:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484282112 00000100:00100000:0.0:1789302650.497659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00100000:0.0:1789302650.497667:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69361ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+6:2350:x1876219484282112:12345-192.168.203.42@tcp:39:umount.0 00000020:00000080:0.0:1789302650.497727:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f115ec 00000020:00010000:0.0:1789302650.497737:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a6806f04800: total 0 00000100:00080000:0.0:1789302650.497743:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9a6806f02000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789302650.497779:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1789302650.498052:0:5833:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a6806f04800: total 0 00010000:00010000:3.0:1789302650.498057:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302650.498199:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6806f04800, canceled 0 locks, left on hash table 1. 00000100:00100000:0.0:1789302650.498201:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69361ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f0a8600-9374-4911-bbb2-b7f7408433cb+5:2350:x1876219484282112:12345-192.168.203.42@tcp:39:umount.0 Request processed in 535us (1689us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789302650.498209:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 240 00000100:00080000:0.0:1789302650.498228:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789302650.498229:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039100) 00010000:00010000:3.0:1789302650.498233:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302650.498240:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7200/0x20be524657f1250b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b39fc expref: 4 pid: 9859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302650.498260:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6806f04800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789302650.498270:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302650.498272:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302650.498274:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302650.509029:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302650.509440:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484282368 00000100:00100000:2.0:1789302650.509455:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484282368 00000100:00100000:2.0:1789302650.509596:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 303 00000100:00100000:2.0:1789302650.509610:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+7:2350:x1876219484282368:12345-192.168.203.42@tcp:251:umount.0 00000020:00000080:2.0:1789302650.509670:0:5838:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f114e2 00000020:00010000:2.0:1789302650.509692:0:5838:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a6805802800: total 0 00000100:00080000:2.0:1789302650.509699:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9a6805806800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789302650.509798:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fa0c5b74-f3e3-435b-a0ad-f716a60f5a86+3:2350:x1876219484282368:12345-192.168.203.42@tcp:251:umount.0 Request processed in 191us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302650.509807:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 303 00000020:00010000:3.0:1789302650.510771:0:8459:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a6805802800: total 0 00010000:00010000:3.0:1789302650.510841:0:8459:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6805802800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789302650.510887:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abf200/0x20be524657f11598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3595 expref: 2 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302650.511073:0:8459:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6805802800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789302650.511106:0:8459:0:(genops.c:885:class_export_put()) final put ffff9a6805802800/fa0c5b74-f3e3-435b-a0ad-f716a60f5a86 00010000:00010000:3.0:1789302650.511129:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302650.511131:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302650.511133:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789302650.511516:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6805802800/fa0c5b74-f3e3-435b-a0ad-f716a60f5a86 for MGS 00000020:00000080:1.0:1789302650.511569:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6805806800 for MGS 00000100:00100000:3.0:1789302650.765937:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302650.765966:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505228672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302650.766059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302650.766176:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505228672 00000100:00100000:1.0:1789302650.766186:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505228672 00000100:00100000:1.0:1789302650.766257:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302650.766268:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505228672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302650.766334:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302650.766394:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505228672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302650.766402:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789302650.766453:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505228672:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789302650.766750:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789302650.767359:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505228928:0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767402:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302650.767427:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302650.767432:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69361ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505228800:0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302650.767498:0:9859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505228928 00000100:00100000:1.0:1789302650.767504:0:9859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505228928 00000100:00100000:1.0:1789302650.767536:0:9859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789302650.767544:0:9859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505228928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767582:0:9859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505228928:12345-0@lo:400:kworker.0 Request processed in 39us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302650.767589:0:9859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789302650.767609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505228800 00000100:00100000:1.0:1789302650.767612:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505228800 00000100:00100000:1.0:1789302650.767633:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789302650.767639:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505228800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767664:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505228800:12345-0@lo:400:kworker.0 Request processed in 26us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302650.767670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789302650.767778:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505228800:0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767792:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69361ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505228928:0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767809:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505229056:0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767830:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302650.767847:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302650.767851:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505229184:0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302650.767887:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505229056 00000100:00100000:1.0:1789302650.767890:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505229056 00000100:00100000:1.0:1789302650.767915:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505229184 00000100:00100000:1.0:1789302650.767917:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505229184 00000100:00100000:1.0:1789302650.767941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789302650.767946:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505229056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.767974:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505229056:12345-0@lo:400:kworker.0 Request processed in 28us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302650.767980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789302650.767989:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789302650.767995:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505229184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.768015:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505229184:12345-0@lo:400:kworker.0 Request processed in 20us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302650.768020:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1789302650.768035:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302650.768055:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505229184:0@lo:400:kworker.0 00000100:00100000:1.0:1789302650.768063:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505229056:0@lo:400:kworker.0 00010000:00010000:1.0:1789302650.957609:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789302651.345690:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:1.0:1789302651.345700:0:6722:0:(genops.c:885:class_export_put()) final put ffff9a6906125000/ace2f696-3715-4928-b36c-02db3411d1a3 00000020:00000080:1.0:1789302651.345737:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6906125000/ace2f696-3715-4928-b36c-02db3411d1a3 for lustre-OST0000 00000020:00000080:1.0:1789302651.345777:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6906127800 for lustre-OST0000 00010000:00010000:3.0:1789302651.981588:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789302652.384152:0:13085:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789302652.405468:0:13085:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789302652.405525:0:13085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.405542:0:13085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.405563:0:13085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.405570:0:13085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.405591:0:13085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789302652.405596:0:13085:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789302652.405621:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302652.405626:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789302652.405632:0:13085:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789302652.405656:0:13085:0:(import.c:65:import_set_state_nolock()) ffff9a691dd06000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789302652.406358:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302652.406374:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.406386:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900030800 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302652.406392:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.406404:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302652.406413:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302652.406419:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789302652.406422:0:8459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789302652.406426:0:8459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789302652.406481:0:8459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.406488:0:8459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302652.406538:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.406563:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900030800/0x20be524657f11567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f1156e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.406581:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302652.406584:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302652.406586:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302652.406747:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505229312:0@lo:39:umount.0 00000100:00100000:2.0:1789302652.406835:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302652.406862:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505229440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302652.406906:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302652.406962:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505229440 00000100:00100000:0.0:1789302652.406971:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505229440 00000100:00100000:0.0:1789302652.407046:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302652.407057:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+19:3303:x1876219505229440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302652.407073:0:6712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302652.407091:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abf600/0x20be524657f1156e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11567 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.407107:0:6712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302652.407148:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8df8e325-951a-4604-89fa-82b64ca867d0+18:3303:x1876219505229440:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302652.407155:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789302652.407213:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505229440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302652.407282:0:6295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505229312 00000100:00100000:3.0:1789302652.407316:0:6295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505229312 00000100:00100000:3.0:1789302652.407357:0:6295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789302652.407364:0:6295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876219505229312:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789302652.407393:0:6295:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f112ff 00000100:00080000:3.0:1789302652.407405:0:6295:0:(import.c:65:import_set_state_nolock()) ffff9a693c21b800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789302652.407483:0:6295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1876219505229312:12345-0@lo:39:umount.0 Request processed in 119us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302652.407490:0:6295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789302652.407500:0:6295:0:(genops.c:885:class_export_put()) final put ffff9a693c21d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789302652.407539:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a693c21d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789302652.407595:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a693c21b800 for lustre-MDT0000 00000100:00080000:3.0:1789302652.407627:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a691dd06000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789302652.407647:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505229312:0@lo:39:umount.0 00000100:00080000:1.0:1789302652.407685:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789302652.407693:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789302652.407700:0:13085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789302652.407884:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302652.411044:0:13085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411064:0:13085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411075:0:13085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411083:0:13085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411109:0:13085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302652.411115:0:13085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411122:0:13085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411132:0:13085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411138:0:13085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411157:0:13085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789302652.411164:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302652.411165:0:13085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.411181:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.411194:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6923abf800 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302652.411203:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411214:0:13085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411229:0:13085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.411249:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411252:0:13085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302652.411279:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411318:0:13085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789302652.411326:0:13085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411334:0:13085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.411339:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302652.411341:0:13085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.411349:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302652.411371:0:13085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.411404:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6e00 already unused, calling callback (ffffffffc1a60c20) 00010000:00010000:0.0:1789302652.411406:0:13085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:2.0:1789302652.411412:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302652.411416:0:13085:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789302652.411429:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302652.411437:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302652.411444:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789302652.411448:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789302652.411453:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:01000004:0.0:1789302652.411454:0:13085:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789302652.411463:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789302652.411468:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302652.411473:0:13085:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1789302652.411483:0:13085:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9a6806f06000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789302652.411497:0:13085:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9a6927ba4000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789302652.411511:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789302652.411511:0:13085:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9a6806f04800 2f0a8600-9374-4911-bbb2-b7f7408433cb 192.168.203.42@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789302652.411538:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1789302652.411540:0:13085:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9a690a5d8000) has exports, disconnecting them 00000020:00080000:0.0:1789302652.411547:0:13085:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a6806f06000), last request at 1789302650 00000020:00000080:0.0:1789302652.411558:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11464 00010000:00010000:2.0:1789302652.411584:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.411595:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba6e00/0x20be524657f1149c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f114a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.411626:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302652.411631:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.411638:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69421c9800 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302652.411641:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.411657:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302652.411677:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505229568:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789302652.411685:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302652.411694:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789302652.411697:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789302652.411700:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789302652.411720:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.411727:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789302652.411760:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302652.411850:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505229696:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789302652.411867:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789302652.411873:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789302652.411876:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00100000:1.0:1789302652.411894:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789302652.411899:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.411914:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789302652.411942:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302652.411953:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505229824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302652.411973:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302652.412004:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505229568 00000100:00100000:1.0:1789302652.412013:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505229568 00000100:00100000:1.0:1789302652.412062:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505229696 00000100:00100000:1.0:1789302652.412068:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505229696 00000100:00100000:1.0:1789302652.412081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505229824 00000100:00100000:1.0:1789302652.412083:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505229824 00000100:00100000:1.0:1789302652.412102:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789302652.412110:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+20:3304:x1876219505229568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302652.412124:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302652.412143:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7e00/0x20be524657f114a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f1149c expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.412161:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302652.412194:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+19:3304:x1876219505229568:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302652.412205:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789302652.412224:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789302652.412231:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+18:3305:x1876219505229696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302652.412238:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302652.412247:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69033f9800/0x20be524657f117a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f1179e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.412255:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302652.413972:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+17:3305:x1876219505229696:12345-0@lo:103:ldlm_bl.0 Request processed in 1732us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302652.413984:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789302652.414034:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302652.414045:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806971880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+16:3305:x1876219505229824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302652.414068:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302652.414088:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c9c00/0x20be524657f1157c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11575 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.414107:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302652.414160:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806971880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+15:3305:x1876219505229824:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302652.414166:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302652.414227:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505229824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302652.414240:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505229696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302652.414278:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505229568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302652.414308:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302652.414515:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302652.414526:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.414538:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031600 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302652.414543:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.414555:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302652.414563:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302652.414586:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302652.414589:0:8459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789302652.414900:0:8459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789302652.415070:0:8459:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.415077:0:8459:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302652.415098:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.415104:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900031600/0x20be524657f11250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11257 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.415119:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302652.415121:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302652.415123:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302652.415131:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302652.415142:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505229952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302652.415186:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302652.415218:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505229952 00000100:00100000:1.0:1789302652.415224:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505229952 00000100:00100000:1.0:1789302652.415261:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302652.415269:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806971f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+15:3304:x1876219505229952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302652.415308:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302652.415317:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c8e00/0x20be524657f11257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11250 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302652.415329:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302652.415365:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806971f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8df8e325-951a-4604-89fa-82b64ca867d0+14:3304:x1876219505229952:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302652.415372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302652.415401:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8df8e325-951a-4604-89fa-82b64ca867d0:3304:1876219505229952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789302652.415414:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302652.415416:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789302652.417193:0:13085:0:(import.c:65:import_set_state_nolock()) ffff9a6806f02800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789302652.417225:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.417244:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69421c9800/0x20be524657f1179e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f117a5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302652.417278:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302652.417281:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302652.417304:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789302652.417313:0:13085:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6806f06000): rc 0 00000020:00000080:0.0:1789302652.417317:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6806f06000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789302652.417347:0:13085:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a6927ba4000), last request at 1789302650 00000020:00000080:0.0:1789302652.417355:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11399 00000100:00080000:0.0:1789302652.417364:0:13085:0:(import.c:65:import_set_state_nolock()) ffff9a6936398000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789302652.417376:0:13085:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6927ba4000): rc 0 00000020:00000080:0.0:1789302652.417378:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6927ba4000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789302652.417386:0:13085:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae4640d1fae0 00000100:00080000:0.0:1789302652.417405:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789302652.417409:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789302652.417423:0:13085:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1789302652.417455:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6806f06000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1789302652.417505:0:13085:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:2.0:1789302652.417529:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6927ba4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1789302652.417530:0:13085:0:(import.c:65:import_set_state_nolock()) ffff9a6936529800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789302652.417556:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789302652.417560:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000020:00000080:2.0:1789302652.417574:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6806f02800 for lustre-MDT0000 00000004:00080000:0.0:1789302652.417576:0:13085:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:2.0:1789302652.417584:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6936398000 for lustre-MDT0000 00000100:00080000:0.0:1789302652.417652:0:13085:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789302652.417676:0:13085:0:(import.c:65:import_set_state_nolock()) ffff9a69369e9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789302652.417707:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9a690a5d8000) has no exports 00010000:00010000:3.0:1789302652.417963:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.417974:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6923abf800/0x20be524657f11575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f1157c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302652.417986:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302652.417989:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302652.417991:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302652.418016:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505230080:0@lo:9:umount.0 00000100:00100000:3.0:1789302652.418107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302652.418185:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505230208:0@lo:9:umount.0 00000100:00100000:3.0:1789302652.418213:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302652.418610:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505230080 00000100:00100000:2.0:1789302652.418622:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505230080 00000100:00100000:2.0:1789302652.418787:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505230208 00000100:00100000:2.0:1789302652.418806:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505230208 00000100:00100000:3.0:1789302652.418876:0:10693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789302652.418889:0:10693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876219505230080:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789302652.418931:0:10693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f113e6 00000100:00080000:3.0:1789302652.418944:0:10693:0:(import.c:65:import_set_state_nolock()) ffff9a6927ba1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789302652.418987:0:10693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789302652.419410:0:10693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3302:x1876219505230080:12345-0@lo:9:umount.0 Request processed in 523us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302652.419418:0:10693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789302652.419469:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a6936529800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789302652.419485:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789302652.419487:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789302652.419492:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505230080:0@lo:9:umount.0 00010000:00010000:3.0:1789302652.419522:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789302652.419863:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302652.419870:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302652.420121:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789302652.420132:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69363f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876219505230208:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789302652.420155:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f114cd 00000100:00080000:2.0:1789302652.420163:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9a6806f06800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789302652.420192:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1789302652.422482:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302652.422501:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302652.423103:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69363f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1876219505230208:12345-0@lo:9:umount.0 Request processed in 2965us (4879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302652.423118:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789302652.423660:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69369e9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789302652.423704:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789302652.423710:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789302652.423717:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505230208:0@lo:9:umount.0 00010000:00010000:3.0:1789302652.424017:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789302652.432264:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9a690a5d8000) has no exports 00000020:00000080:0.0:1789302652.512803:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f112ab 00000020:00000080:0.0:1789302652.512818:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6936e65800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789302652.512889:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789302652.513084:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936e65800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789302652.513109:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302652.513120:0:13085:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789302652.513124:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9a693d768000) has no exports 00000020:00000080:2.0:1789302652.513547:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f112a4 00000020:00000080:2.0:1789302652.513553:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a693d772800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789302652.513609:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302652.513617:0:13085:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789302652.513620:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a691dd05800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789302652.513622:0:13085:0:(genops.c:844:class_export_destroy()) destroying export ffff9a691dd05800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789302652.513626:0:13085:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789302652.514879:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a693d772800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789302653.005738:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302654.029748:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302655.053592:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789302655.433013:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f0a8600-9374-4911-bbb2-b7f7408433cb 00000001:00080000:1.0:1789302655.433036:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789302655.433044:0:5867:0:(genops.c:885:class_export_put()) final put ffff9a6806f04800/2f0a8600-9374-4911-bbb2-b7f7408433cb 00000020:00000080:1.0:1789302655.433070:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6806f04800/2f0a8600-9374-4911-bbb2-b7f7408433cb for lustre-MDT0000 00000020:00000080:1.0:1789302655.433482:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6806f02000 for lustre-MDT0000 00000001:00100000:1.0:1789302655.504230:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789302655.504241:0:7652:0:(genops.c:885:class_export_put()) final put ffff9a6806f03800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789302655.507534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6806f03800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789302655.511252:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6806f06800 for lustre-OST0001 00000100:00100000:2.0:1789302655.885715:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876219505230592:0@lo:400:kworker.0 00000100:00100000:2.0:1789302655.885808:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302655.885891:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789302655.885897:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505230464:0@lo:400:kworker.0 00000100:00100000:2.0:1789302655.885920:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302655.886011:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302655.886022:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505230336:0@lo:400:kworker.0 00000100:00100000:0.0:1789302655.886063:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302655.886651:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505230336 00000100:00100000:2.0:1789302655.886663:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505230336 00000100:00100000:2.0:1789302655.886749:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789302655.886759:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:3303:x1876219505230336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302655.886828:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6903e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8df8e325-951a-4604-89fa-82b64ca867d0+14:3303:x1876219505230336:12345-0@lo:400:kworker.0 Request processed in 70us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302655.886835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789302655.886957:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505230336:0@lo:400:kworker.0 00000100:00100000:1.0:1789302655.887097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505230592 00000100:00100000:1.0:1789302655.887103:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505230592 00000100:00100000:1.0:1789302655.887138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505230464 00000100:00100000:1.0:1789302655.887142:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505230464 00000100:00100000:1.0:1789302655.887164:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789302655.887170:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1876219505230592:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789302655.887177:0:5847:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789302655.887227:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1876219505230592:12345-0@lo:400:kworker.0 Request processed in 56us (1418us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789302655.887233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789302655.887247:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789302655.887251:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1876219505230464:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789302655.887255:0:5847:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789302655.887278:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1876219505230464:12345-0@lo:400:kworker.0 Request processed in 24us (1356us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789302655.887322:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1789302655.887405:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789302655.887411:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a693652a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789302655.887415:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789302655.895093:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a693652a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302655.895113:0:3306:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 153 00000100:00080000:0.0:1789302655.895132:0:3306:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a693652a800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789302655.895187:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68053da680 x1876219505230720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302655.895340:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876219505230720:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789302655.895427:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302655.895543:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505230464:0@lo:400:kworker.0 00000100:00080000:0.0:1789302655.895580:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789302655.895602:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a693d776000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789302655.895607:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789302655.895610:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a693d776000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302655.895614:0:3306:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 174 00000100:00080000:0.0:1789302655.895621:0:3306:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a693d776000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789302655.895636:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68053dad80 x1876219505230848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302655.895736:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505230720 00000100:00100000:1.0:1789302655.895745:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505230720 00000100:00100000:1.0:1789302655.895796:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789302655.895805:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1876219505230720:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789302655.895825:0:5846:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789302655.896491:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876219505230848:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789302655.896537:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302655.896695:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1876219505230592:0@lo:400:kworker.0 00000100:00100000:2.0:1789302655.896864:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505230848 00000100:00100000:2.0:1789302655.896871:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505230848 00000100:00100000:2.0:1789302655.896937:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789302655.896944:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505230848:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789302655.896957:0:5845:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789302655.897017:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505230848:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 72us (479us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789302655.897025:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1789302655.897084:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a693d776000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302655.897090:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789302655.897093:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876219505230848:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789302655.921238:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1876219505230720:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 25423us (25802us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789302655.921252:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1789302655.921358:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a693652a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302655.921370:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789302655.921376:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876219505230720:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1789302656.077679:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789302656.490581:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789302656.490590:0:6722:0:(genops.c:885:class_export_put()) final put ffff9a693639f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789302656.490854:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a693639f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789302656.490912:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6927ba1000 for lustre-OST0000 00010000:00010000:3.0:1789302657.102425:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302658.125516:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789302658.573438:0:13085:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6903387600 - data ffff9a6941c371b0/ffff9a693c5a6800 00000020:01000000:0.0:1789302658.573772:0:13085:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6908cbc1e0 - data ffff9a6932f5ae58/ffff9a6902e3f400 00000001:00000004:1.0:1789302658.603462:0:13085:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:1.0:1789302658.673221:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789302658.673231:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1789302658.673259:0:13085:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789302658.673262:0:13085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789302658.673613:0:6835:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789302658.673618:0:6835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1789302658.673637:0:6835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789302658.675237:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789302658.675243:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1789302658.675262:0:13085:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789302658.675265:0:13085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789302658.675757:0:8018:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789302658.675762:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789302658.675770:0:8018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789302658.725871:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11273 00000020:00000080:1.0:1789302658.725882:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6936eaa800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789302658.726119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936eaa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789302658.727845:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11288 00000020:00000080:1.0:1789302658.727855:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6936eaf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789302658.727865:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789302658.727870:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302658.727879:0:13085:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789302658.727883:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9a690a5db380) has no exports 00000020:00000080:3.0:1789302658.728143:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936eaf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789302658.728222:0:13085:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789302658.728232:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f114c6 00000020:00000080:1.0:1789302658.728236:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a69369ef000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789302658.728253:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789302658.728262:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302658.728268:0:13085:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789302658.728271:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9a690a4199c0) has no exports 00000020:00000080:1.0:1789302658.728277:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f114bf 00000020:00000080:1.0:1789302658.728281:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a693c219000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789302658.728657:0:13085:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789302658.728670:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789302658.728675:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789302658.728681:0:13085:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789302658.728683:0:13085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789302658.728714:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302658.728722:0:13085:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789302658.728726:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f113df 00000020:00000080:1.0:1789302658.728731:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a680506f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789302658.728735:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789302658.728739:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302658.728743:0:13085:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789302658.728757:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9a693ba60000) has no exports 00000020:00000080:1.0:1789302658.728761:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f113d8 00000020:00000080:1.0:1789302658.728764:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a693652d000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789302658.729232:0:13085:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789302658.729236:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789302658.729238:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789302658.729242:0:13085:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789302658.729244:0:13085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789302658.729269:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302658.729274:0:13085:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789302658.729323:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302658.729327:0:13085:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789302658.729330:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a690a58b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789302658.729333:0:13085:0:(genops.c:844:class_export_destroy()) destroying export ffff9a690a58b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789302658.729338:0:13085:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789302658.729501:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f1128f 00000020:00000080:1.0:1789302658.729507:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6936eac800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789302658.729514:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789302658.729518:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302658.729522:0:13085:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789302658.729525:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9a690a5d99c0) has no exports 00000020:00000080:1.0:1789302658.729544:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302658.729547:0:13085:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789302658.729551:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11296 00000020:00000080:1.0:1789302658.729555:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6936ea8000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789302658.729562:0:13085:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6905909800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789302658.729566:0:13085:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6905909800 3 00000020:01000004:1.0:1789302658.729570:0:13085:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6905909800 from lustre-MDT0000 00000020:00000080:1.0:1789302658.729587:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302658.729591:0:13085:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789302658.729594:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6936eae000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789302658.729596:0:13085:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936eae000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789302658.729606:0:13085:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1789302658.729960:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69369ef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789302658.729970:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a693c219000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789302658.729976:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a69369e9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789302658.729981:0:36:0:(genops.c:885:class_export_put()) final put ffff9a6805291000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789302658.729984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6805291000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789302658.729987:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789302658.730102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a680506f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789302658.730108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a693652d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789302658.730113:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a6936529800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789302658.730118:0:36:0:(genops.c:885:class_export_put()) final put ffff9a6805806000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789302658.730121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6805806000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789302658.730124:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789302658.730190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936eac800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789302658.730194:0:36:0:(genops.c:885:class_export_put()) final put ffff9a6936eaf000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789302658.730196:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936eaf000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789302658.730200:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789302658.730376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936ea8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789302658.730528:0:13085:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789302658.730534:0:13085:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789302658.730538:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789302658.730542:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302658.730545:0:13085:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789302658.730552:0:13085:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9a690a59a800 8df8e325-951a-4604-89fa-82b64ca867d0 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789302658.730558:0:13085:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9a6908ca8000) has exports, disconnecting them 00000020:00080000:1.0:1789302658.730562:0:13085:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a690a59a800), last request at 1789302422 00000020:00000080:1.0:1789302658.730576:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11234 00000020:00010000:1.0:1789302658.730581:0:13085:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9a690a59a800: total 0 00000100:00080000:1.0:1789302658.730585:0:13085:0:(import.c:65:import_set_state_nolock()) ffff9a690a59b800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789302658.730608:0:13085:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a690a59a800): rc 0 00000020:00080000:1.0:1789302658.730612:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9a6908ca8000) has no exports 00000020:00010000:2.0:1789302658.730740:0:13086:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9a690a59a800: total 0 00010000:00010000:2.0:1789302658.730770:0:13086:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a690a59a800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789302658.730798:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c9000/0x20be524657f11797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11790 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302658.730817:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abfa00/0x20be524657f1134c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11345 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302658.730832:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abe200/0x20be524657f1158a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11583 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302658.730859:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c8800/0x20be524657f11789 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11782 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302658.730873:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69421c9400/0x20be524657f11536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f1152f expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302658.730884:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abee00/0x20be524657f11552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f1154b expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302658.730895:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abe600/0x20be524657f11544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f1153d expref: 3 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302658.730905:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6923abe400/0x20be524657f11560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x20be524657f11559 expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302658.730916:0:13086:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a690a59a800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789302658.730928:0:13086:0:(genops.c:885:class_export_put()) final put ffff9a690a59a800/8df8e325-951a-4604-89fa-82b64ca867d0 00010000:00010000:2.0:1789302658.730941:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302658.730943:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302658.730945:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789302658.730952:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a690a59a800/8df8e325-951a-4604-89fa-82b64ca867d0 for MGS 00000020:00000080:2.0:1789302658.730983:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a690a59b800 for MGS 00000100:00100000:3.0:1789302658.731130:0:5840:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a690344ee00:5840] 2 exiting: rc = 0 00000100:00100000:1.0:1789302658.731232:0:5838:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a6908d26000:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1789302658.732483:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a690344e600:5839] 1 exiting: rc = 0 00000100:00100000:2.0:1789302658.733234:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733244:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733251:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733259:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733266:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733272:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733278:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733314:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733331:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733337:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733343:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733350:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733356:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733362:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733368:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733374:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733380:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733386:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733393:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733400:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733407:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733413:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733422:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733429:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733435:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733441:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733447:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733453:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733458:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733464:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733470:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733476:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733482:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733488:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733495:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733500:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733506:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733511:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733517:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733523:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733528:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733535:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733540:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733554:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733559:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733566:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733573:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733579:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733585:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733591:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733596:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733602:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733608:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.733614:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734471:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734486:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734493:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734500:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734506:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734512:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734518:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734523:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734529:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.734535:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789302658.735639:0:13085:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789302658.735646:0:13085:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1789302658.737195:0:13085:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a690b879a80 - data ffff9a6930caa510/ffff9a693c5fc400 00000020:01000000:2.0:1789302658.739841:0:13085:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6923baef60 - data ffff9a6932f96bd0/ffff9a6904367800 00000020:00000080:2.0:1789302658.740442:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11218 00000020:00000080:2.0:1789302658.740449:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6903f2f800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789302658.740499:0:13085:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6905909800 from MGS, refs=2 00000020:01000004:2.0:1789302658.740502:0:13085:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6905909800 2 00000020:01000004:2.0:1789302658.740506:0:13085:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6905909800 from MGS 00000020:00000080:2.0:1789302658.740529:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302658.740535:0:13085:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789302658.740537:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6903f2e800/MGS 00000020:00000080:2.0:1789302658.740540:0:13085:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6903f2e800/MGS for MGS 00000020:01000000:2.0:1789302658.740545:0:13085:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789302658.740605:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789302658.740609:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302658.740613:0:13085:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789302658.740630:0:13085:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a6936eab000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789302658.740636:0:13085:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9a693ba619c0) has exports, disconnecting them 00000020:00080000:2.0:1789302658.740641:0:13085:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a6936eab000), last request at 1789302423 00000020:00000080:2.0:1789302658.740645:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f112e3 00000020:00080000:2.0:1789302658.740653:0:13085:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6936eab000): rc 0 00000020:00000080:2.0:1789302658.740657:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6936eab000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789302658.741158:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6903f2f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789302658.741361:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936eab000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789302658.742433:0:13085:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789302658.742439:0:13085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789302658.742443:0:13085:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789302658.742449:0:13085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789302658.742599:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302658.742606:0:13085:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789302658.742612:0:13085:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6905909800 1 00000020:00000080:3.0:1789302658.742616:0:13085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f1120a 00000020:00000080:3.0:1789302658.742633:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6903f28800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789302658.742637:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789302658.742651:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302658.742655:0:13085:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789302658.742659:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9a6908cab380) has no exports 00000020:00000080:1.0:1789302658.742816:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a691dd06000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789302658.742823:0:38:0:(genops.c:885:class_export_put()) final put ffff9a6936ea8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789302658.742825:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936ea8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789302658.742830:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789302658.742886:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6903f28800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789302658.779857:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302658.779871:0:13085:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789302658.779877:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a6903f2d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789302658.779881:0:13085:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6903f2d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789302658.779891:0:13085:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789302658.780019:0:13085:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a690590b800 00000020:01000000:1.0:1789302658.780781:0:13085:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789302658.780787:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302658.780793:0:13085:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789302658.780797:0:13085:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9a690a5dcd40) has no exports 00000100:00100000:1.0:1789302658.780893:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9a6908d7e800:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1789302658.781523:0:9859:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff9a6935fe9000:9859] 4 exiting: rc = 0 00000100:00100000:2.0:1789302658.781649:0:5847:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9a6923a9ca00:5847] 2 exiting: rc = 0 00000100:00100000:2.0:1789302658.781701:0:5845:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9a6923a9c400:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1789302658.786829:0:6295:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9a6902fa2000:6295] 3 exiting: rc = 0 00000100:00100000:1.0:1789302658.790865:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790878:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790884:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790891:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790896:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790902:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790908:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790913:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790919:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790924:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790929:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790935:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790959:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790969:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790976:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790988:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.790994:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791000:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791006:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791012:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791018:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791024:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791031:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791037:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791042:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791052:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791057:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791063:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791068:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791073:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791079:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791085:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791090:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791096:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791101:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791107:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791272:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791279:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791368:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791374:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791380:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791385:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791391:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791397:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791403:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791408:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791414:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791427:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791433:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791438:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791444:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791449:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791664:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791675:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791683:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791690:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791700:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791707:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791716:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791723:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791729:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791735:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791741:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.791746:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.797405:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a6903537400:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1789302658.797405:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a6906d05e00:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1789302658.798193:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798202:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798209:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798215:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798221:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798229:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798235:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798241:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798248:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798255:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798262:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798281:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798455:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798461:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798467:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798473:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798478:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798483:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798501:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798506:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798510:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798516:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798523:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798529:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798534:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798540:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798545:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798550:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798556:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798561:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798567:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798572:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798577:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798582:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798587:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798591:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798596:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798601:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798607:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798612:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798617:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798633:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798639:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798644:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798649:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798654:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798659:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798664:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798670:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798675:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798679:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798684:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798688:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798701:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798706:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798712:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798718:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798723:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798728:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798733:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798738:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798744:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798749:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.798755:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.799641:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9a691ec56c00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1789302658.799811:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9a691ec57e00:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1789302658.799908:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799917:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799924:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799930:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799936:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799942:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799962:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799968:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799975:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799981:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799988:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.799994:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800000:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800007:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800016:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800023:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800029:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800034:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800055:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800062:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800067:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800074:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800080:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800086:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800100:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800106:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800111:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800117:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800123:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800130:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800150:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800157:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800163:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800169:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800175:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800180:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800186:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800192:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800199:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800205:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800212:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800218:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800238:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800246:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800252:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800258:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800264:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800271:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800277:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800407:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800417:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800424:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800430:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800436:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800456:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800463:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800469:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800475:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800482:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800496:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800501:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800508:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800514:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302658.800520:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.809426:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a6903ead600:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1789302658.809733:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a6903eac400:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1789302658.810052:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810060:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810065:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810071:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810076:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810082:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810088:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810094:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810099:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810104:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810109:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810114:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810120:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810125:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810131:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810136:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810141:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810146:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810163:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810169:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810174:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810180:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810185:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810191:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810196:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810200:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810205:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810210:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810215:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810220:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810225:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810229:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810233:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810238:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810243:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810248:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810253:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810258:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810263:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810267:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810273:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810277:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810281:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810414:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810420:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810425:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810430:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810435:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810440:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810445:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810450:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810454:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810459:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810469:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810474:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810478:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810483:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810488:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810493:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810498:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810503:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810508:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810513:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.810518:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.810895:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a6906d05800:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1789302658.811004:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a6903ead000:5854] 0 exiting: rc = 1 00000100:00100000:2.0:1789302658.811075:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811081:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811087:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811092:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811098:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811103:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811108:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811113:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811118:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811124:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811129:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811133:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811138:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811143:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811147:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811152:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811157:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811161:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811165:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811170:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811175:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811180:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811184:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811189:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811201:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811206:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811211:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811216:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811221:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811226:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811231:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811236:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811240:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811244:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811249:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811253:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811258:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811263:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811268:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811273:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811277:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811282:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811316:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811321:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811326:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811331:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811335:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811340:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811345:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811350:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811354:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811359:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811363:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811368:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811373:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811377:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811382:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811386:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811391:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811401:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811405:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811411:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811415:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302658.811420:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.811786:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a6906d05200:5856] 0 exiting: rc = 1 00000100:00100000:1.0:1789302658.811876:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a6906d04400:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1789302658.811960:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.811967:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.811973:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.811978:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.811984:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.811989:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.811995:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812001:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812006:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812012:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812017:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812022:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812027:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812032:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812038:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812043:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812048:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812053:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812058:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812062:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812067:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812072:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812077:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812083:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812096:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812101:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812107:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812112:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812116:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812122:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812127:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812132:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812136:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812141:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812146:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812150:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812155:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812160:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812166:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812172:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812177:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812181:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812187:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812192:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812196:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812201:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812206:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812211:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812216:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812220:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812226:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812231:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812237:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812241:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812247:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812251:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812256:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812261:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812266:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812278:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812282:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812316:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812320:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812325:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.812964:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9a6903eaca00:5859] 1 exiting: rc = 0 00000100:00100000:2.0:1789302658.813212:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9a6927b9ae00:5860] 2 exiting: rc = 0 00000100:00100000:1.0:1789302658.813493:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9a6908cb2000:5858] 0 exiting: rc = 1 00000100:00100000:3.0:1789302658.813607:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813615:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813632:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813637:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813643:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813650:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813656:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813662:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813668:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813685:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813692:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813698:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813703:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813709:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813714:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813720:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813726:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813734:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813740:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813745:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813751:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813757:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813763:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813768:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813774:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813780:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813786:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813791:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813796:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813812:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813818:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813824:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813829:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813849:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813855:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813861:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813867:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813873:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813879:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813884:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813890:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813896:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813902:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813907:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813912:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813918:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813924:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813929:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813935:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813940:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813946:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813952:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813959:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813964:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813971:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813977:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813983:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813990:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.813996:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.814002:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.814007:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.814013:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.814019:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302658.814025:0:13085:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789302658.818961:0:13085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302658.818974:0:13085:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789302658.818980:0:13085:0:(genops.c:885:class_export_put()) final put ffff9a690a58a000/MDS_uuid 00000020:00000080:3.0:1789302658.818984:0:13085:0:(genops.c:844:class_export_destroy()) destroying export ffff9a690a58a000/MDS_uuid for MDS 00000020:01000000:3.0:1789302658.818990:0:13085:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789302658.819132:0:13085:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789302659.152106:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302660.173474:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302661.005673:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302661.005681:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302661.005685:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a693652a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302661.005692:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 367 00000100:00080000:3.0:1789302661.005698:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789302661.005711:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a693652a800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789302661.005732:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806191180 x1876219505231104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302661.005796:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876219505231104:0@lo:38:kworker.0 00000400:00000100:2.0:1789302661.005854:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219505231104 offset 0 length 520: 4 00000100:00080000:3.0:1789302661.005927:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789302661.005931:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302661.005933:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a693d776000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302661.005937:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 367 00000100:00080000:3.0:1789302661.005940:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789302661.005945:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a693d776000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789302661.005960:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806192680 x1876219505231232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302661.006026:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505230976:0@lo:400:kworker.0 00000400:00000100:0.0:1789302661.006054:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876219505230976 offset 0 length 224: 4 00000100:00100000:2.0:1789302661.016730:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876219505231232:0@lo:38:kworker.0 00000400:00000100:2.0:1789302661.016794:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876219505231232 offset 0 length 520: 4 00010000:00010000:0.0:1789302661.212308:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789302661.647109:0:13241:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789302661.662452:0:13241:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789302661.662500:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.662534:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.662541:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.662549:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.662619:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789302661.662624:0:13241:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789302661.662647:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302661.662658:0:13241:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6806191180 x1876219505231104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302676 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302661.662679:0:13241:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789302661.662685:0:13241:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789302661.662690:0:13241:0:(import.c:65:import_set_state_nolock()) ffff9a693652a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789302661.662695:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789302661.662698:0:13241:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6806191180 x1876219505231104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302676 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302661.662704:0:13241:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789302661.662707:0:13241:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1789302661.664054:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876219505231104:0@lo:38:kworker.0 00010000:00010000:0.0:1789302661.664982:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.664997:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.665021:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.665028:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302661.667737:0:13086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302661.667751:0:13086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302661.667763:0:13086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031a00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302661.667767:0:13086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302661.667778:0:13086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302661.667785:0:13086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302661.667790:0:13086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789302661.667793:0:13086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789302661.667797:0:13086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789302661.668013:0:13086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302661.668022:0:13086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302661.668054:0:13086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302661.668062:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900031a00/0x20be524657f1154b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302661.668081:0:13086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302661.668084:0:13086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302661.668089:0:13086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900030e00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302661.668093:0:13086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302661.668100:0:13086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302661.668124:0:13086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302661.668130:0:13086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302661.668132:0:13086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789302661.668145:0:13086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302661.668150:0:13086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302661.668168:0:13086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302661.668175:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302661.668177:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302661.668179:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302661.668194:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505231488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302661.668258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302661.668353:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505231488 00000100:00100000:1.0:1789302661.668361:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505231488 00000100:00100000:1.0:1789302661.668402:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789302661.668409:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1876219505231488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789302661.668415:0:5832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789302661 with bad export cookie 2359413716865323572 00000100:00100000:3.0:1789302661.668757:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302661.668769:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505231360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302661.668803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789302661.672999:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302661.673015:0:13241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900030e00/0x20be524657f11559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.673044:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.673052:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.673060:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.673069:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302661.673145:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789302661.673151:0:13241:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1789302661.673158:0:13241:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789302661.673188:0:13241:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789302661.673192:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789302661.673200:0:13241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789302661.673205:0:13241:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789302661.673222:0:13241:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9a690a5919c0) has no exports 00000020:00080000:0.0:1789302661.673247:0:13241:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9a690a5919c0) has no exports 00000020:01000000:0.0:1789302661.674932:0:13241:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6903eec360 - data ffff9a6804caad80/ffff9a693c5ff400 00000020:01000000:0.0:1789302661.675123:0:13241:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a690b879e40 - data ffff9a6930e30798/ffff9a6805030c00 00010000:00010000:2.0:1789302661.678871:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302661.678885:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302661.678918:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9a00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302661.678922:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302661.678932:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302661.678940:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302661.678946:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789302661.678948:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789302661.678951:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789302661.678993:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302661.678999:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789302661.679032:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302661.679039:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69033f9a00/0x20be524657f11790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x20be524657f11797 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302661.679053:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302661.679054:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302661.679056:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302661.679078:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505231616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302661.679137:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302661.679201:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505231360 00000100:00100000:2.0:1789302661.679216:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505231360 00000100:00100000:2.0:1789302661.679243:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505231616 00000100:00100000:2.0:1789302661.679246:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505231616 00000100:00100000:2.0:1789302661.679258:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789302661.679264:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69049b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3303:x1876219505231360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789302661.679270:0:6712:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789302661 with bad export cookie 2359413716865323572 00000100:00100000:2.0:1789302661.679335:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69049b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3303:x1876219505231360:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (10531us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789302661.679341:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789302661.679356:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789302661.679361:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807255500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1876219505231616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789302661.679365:0:6712:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789302661 with bad export cookie 2359413716865323572 00000100:00100000:2.0:1789302661.679393:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807255500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1876219505231616:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (256us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789302661.679398:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789302661.679424:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789302661.679428:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a690ca00000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789302661.679432:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.142@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1789302661.681429:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1876219505231488:12345-0@lo:103:ldlm_bl.0 Request processed in 13015us (13167us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789302661.681440:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789302661.686255:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302661.686488:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.142@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789302661.705056:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.142@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789302661.705062:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789302661.705072:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6806193100 x1876219505230976/t0(0) o400->MGC192.168.203.142@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789302677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302661.705087:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6806972a00 x1876219505231488/t0(0) o103->MGC192.168.203.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789302677 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302661.705097:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6806973b80 x1876219505231360/t0(0) o103->MGC192.168.203.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789302677 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302661.705106:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6807255c00 x1876219505231616/t0(0) o103->MGC192.168.203.142@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789302677 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789302661.705131:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789302661.705134:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789302661.705135:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789302661.705189:0:3303:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a690ca00000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:2.0:1789302661.705714:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a690ca00000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789302661.705721:0:3306:0:(import.c:545:import_select_connection()) MGC192.168.203.142@tcp: connect to NID 0@lo last attempt 133 00000100:00080000:2.0:1789302661.705738:0:3306:0:(import.c:666:import_select_connection()) MGC192.168.203.142@tcp: import ffff9a690ca00000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789302661.705768:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6807257480 x1876219505231744/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302661.705830:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8df8e325-951a-4604-89fa-82b64ca867d0:3302:1876219505231744:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1789302661.705877:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876219505231744 offset 0 length 520: 4 00000100:00100000:2.0:1789302661.706049:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8df8e325-951a-4604-89fa-82b64ca867d0:3306:1876219505231616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789302661.706084:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8df8e325-951a-4604-89fa-82b64ca867d0:3305:1876219505231488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302661.706931:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505230976:0@lo:400:kworker.0 00000100:00100000:1.0:1789302661.706954:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8df8e325-951a-4604-89fa-82b64ca867d0:3303:1876219505231360:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1789302661.724098:0:13241:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789302661.754612:0:13241:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11368 00000020:00000080:1.0:1789302661.754622:0:13241:0:(genops.c:885:class_export_put()) final put ffff9a6804955800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789302661.754635:0:13241:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6902e2c800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789302661.754639:0:13241:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6902e2c800 2 00000020:01000004:1.0:1789302661.754655:0:13241:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6902e2c800 from lustre-OST0000 00000020:00000080:1.0:1789302661.754680:0:13241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302661.754691:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789302661.754694:0:13241:0:(genops.c:885:class_export_put()) final put ffff9a6804957800/lustre-OST0000_UUID 00000020:00000080:1.0:1789302661.754697:0:13241:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6804957800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789302661.754704:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789302661.754868:0:13241:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789302661.754873:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789302661.754877:0:13241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302661.754884:0:13241:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789302661.754890:0:13241:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a6805804000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789302661.754896:0:13241:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9a693ba63380) has exports, disconnecting them 00000020:00080000:1.0:1789302661.754900:0:13241:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a6805804000), last request at 1789302442 00000020:00000080:1.0:1789302661.754904:0:13241:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11392 00000020:00080000:1.0:1789302661.754914:0:13241:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6805804000): rc 0 00000020:00000080:1.0:1789302661.754919:0:13241:0:(genops.c:885:class_export_put()) final put ffff9a6805804000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789302661.755084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6804955800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789302661.755098:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6805804000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789302661.759441:0:13241:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789302661.759450:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789302661.759454:0:13241:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789302661.759462:0:13241:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789302661.759554:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a693652a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789302661.759688:0:13241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302661.759697:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789302661.759702:0:13241:0:(genops.c:885:class_export_put()) final put ffff9a693652c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789302661.759706:0:13241:0:(genops.c:844:class_export_destroy()) destroying export ffff9a693652c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789302661.759713:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789302661.759778:0:13241:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6902e2c800 1 00000020:00000080:2.0:1789302661.759784:0:13241:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11322 00000020:00000080:2.0:1789302661.759790:0:13241:0:(genops.c:885:class_export_put()) final put ffff9a69049f7800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789302661.759806:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789302661.759810:0:13241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302661.759815:0:13241:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789302661.759830:0:13241:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9a693ba64d40) has no exports 00000020:00000080:3.0:1789302661.760070:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69049f7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789302661.784436:0:13241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302661.784450:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789302661.784456:0:13241:0:(genops.c:885:class_export_put()) final put ffff9a6902e29800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789302661.784460:0:13241:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6902e29800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789302661.784466:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789302661.787084:0:13241:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6902e29000 00000020:02000400:3.0:1789302661.787138:0:13241:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789302662.223756:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302663.245678:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302664.270439:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302665.293506:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789302665.443166:0:13391:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789302665.465130:0:13391:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789302665.465210:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.465226:0:13391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.465233:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.465241:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.465262:0:13391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789302665.465268:0:13391:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789302665.465305:0:13391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789302665.465318:0:13391:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6806192680 x1876219505231232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302676 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302665.465332:0:13391:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789302665.465339:0:13391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789302665.465344:0:13391:0:(import.c:65:import_set_state_nolock()) ffff9a693d776000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789302665.465349:0:13391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789302665.465353:0:13391:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6806192680 x1876219505231232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789302676 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302665.465361:0:13391:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789302665.465364:0:13391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:1.0:1789302665.465602:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302665.465609:0:8459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.465689:0:8459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7800 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302665.465693:0:8459:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.465718:0:8459:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302665.465725:0:8459:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302665.465730:0:8459:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302665.465733:0:8459:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789302665.465735:0:8459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789302665.465748:0:8459:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a690ca00000 00010000:00010000:1.0:1789302665.465752:0:8459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.465758:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba7800/0x20be524657f1152f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x20be524657f11536 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.465768:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302665.465770:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302665.465772:0:8459:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302665.465802:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876219505231232:0@lo:38:kworker.0 00010000:00010000:1.0:1789302665.469459:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.469479:0:13391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.469486:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.469514:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.469537:0:13391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302665.469545:0:13391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.469551:0:13391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.469557:0:13391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.469563:0:13391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.469583:0:13391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789302665.469586:0:13391:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789302665.469606:0:13391:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789302665.469609:0:13391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789302665.469615:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302665.469632:0:13391:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789302665.469637:0:13391:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9a690a594d40) has no exports 00000020:00080000:1.0:1789302665.469659:0:13391:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9a690a594d40) has no exports 00000020:01000000:1.0:1789302665.471383:0:13391:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6903eec2a0 - data ffff9a6930ebfa20/ffff9a69362a2c00 00000020:01000000:1.0:1789302665.471542:0:13391:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a69032bd120 - data ffff9a6941c7e510/ffff9a6906c1e000 00010000:00010000:2.0:1789302665.473853:0:13086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302665.473865:0:13086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.473890:0:13086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6900031e00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302665.473894:0:13086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.473903:0:13086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302665.473909:0:13086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302665.473915:0:13086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789302665.473918:0:13086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789302665.473921:0:13086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789302665.473936:0:13086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a690ca00000 00010000:00010000:2.0:1789302665.473941:0:13086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.473947:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900031e00/0x20be524657f1153d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x20be524657f11544 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.473961:0:13086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302665.473964:0:13086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.473969:0:13086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045800 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:2.0:1789302665.473972:0:13086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.473979:0:13086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789302665.473991:0:13086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302665.473997:0:13086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789302665.473999:0:13086:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789302665.474001:0:13086:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789302665.474006:0:13086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a690ca00000 00010000:00010000:2.0:1789302665.474009:0:13086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.474015:0:13086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6942045800/0x20be524657f11782 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x20be524657f11789 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302665.474029:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302665.474031:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302665.474033:0:13086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302665.474041:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789302665.502414:0:13391:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789302665.540970:0:13391:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11433 00000020:00000080:1.0:1789302665.540979:0:13391:0:(genops.c:885:class_export_put()) final put ffff9a69369fb000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789302665.541011:0:13391:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6936077800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789302665.541028:0:13391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6936077800 2 00000020:01000004:1.0:1789302665.541032:0:13391:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6936077800 from lustre-OST0001 00000020:00000080:1.0:1789302665.541052:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302665.541062:0:13391:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789302665.541066:0:13391:0:(genops.c:885:class_export_put()) final put ffff9a69369f9800/lustre-OST0001_UUID 00000020:00000080:1.0:1789302665.541068:0:13391:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69369f9800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789302665.541075:0:13391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789302665.541172:0:13391:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8df8e325-951a-4604-89fa-82b64ca867d0->MGS 00010000:00010000:1.0:1789302665.541187:0:13391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f1134c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302665.541199:0:13391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f1134c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302665.541205:0:13391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789302665.541208:0:13391:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789302665.541211:0:13391:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789302665.541223:0:13391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a690ca00000 00010000:00010000:1.0:1789302665.541227:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900030a00/0x20be524657f11345 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x20be524657f1134c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302665.541241:0:13391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x20be524657f1158a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302665.541247:0:13391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x20be524657f1158a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302665.541252:0:13391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789302665.541254:0:13391:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789302665.541255:0:13391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789302665.541267:0:13391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a690ca00000 00010000:00010000:1.0:1789302665.541270:0:13391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a6900030200/0x20be524657f11583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x20be524657f1158a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789302665.541317:0:13391:0:(import.c:65:import_set_state_nolock()) ffff9a690ca00000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789302665.541321:0:13391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789302665.541323:0:13391:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789302665.541324:0:13391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789302665.541327:0:13391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789302665.541337:0:13391:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6807257480 x1876219505231744/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789302671 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789302665.541353:0:13391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789302665.541356:0:13391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1789302665.541385:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8df8e325-951a-4604-89fa-82b64ca867d0:3302:1876219505231744:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:1.0:1789302665.541411:0:13391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789302665.541417:0:13391:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11226 00000020:00000080:1.0:1789302665.541422:0:13391:0:(genops.c:885:class_export_put()) final put ffff9a690a588800/8df8e325-951a-4604-89fa-82b64ca867d0 00000020:01000000:1.0:1789302665.541426:0:13391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.142@tcp (flags='') 00000020:00000080:1.0:1789302665.541431:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302665.541435:0:13391:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.142@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789302665.541439:0:13391:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9a690a593380) has no exports 10000000:01000000:1.0:1789302665.541454:0:5842:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789302665.541506:0:13391:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.142@tcp: client import never connected 00000100:00080000:1.0:1789302665.541509:0:13391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789302665.541511:0:13391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789302665.541513:0:13391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789302665.541516:0:13391:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789302665.541544:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789302665.541549:0:13391:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.142@tcp (uuid 8df8e325-951a-4604-89fa-82b64ca867d0) 00000020:01000000:1.0:1789302665.541553:0:13391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789302665.541557:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789302665.541560:0:13391:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789302665.541564:0:13391:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a6806f05800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789302665.541721:0:13391:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9a693bb8cd40) has exports, disconnecting them 00000020:00080000:1.0:1789302665.541726:0:13391:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a6806f05800), last request at 1789302463 00000020:00000080:1.0:1789302665.541730:0:13391:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f1145d 00000020:00080000:1.0:1789302665.541739:0:13391:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6806f05800): rc 0 00000020:00000080:1.0:1789302665.541742:0:13391:0:(genops.c:885:class_export_put()) final put ffff9a6806f05800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789302665.542374:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69369fb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789302665.542390:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a690a588800/8df8e325-951a-4604-89fa-82b64ca867d0 for MGC192.168.203.142@tcp 00000020:00000080:3.0:1789302665.542395:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a690ca00000 for MGC192.168.203.142@tcp 00000020:00000080:3.0:1789302665.542401:0:38:0:(genops.c:885:class_export_put()) final put ffff9a690590b000/8df8e325-951a-4604-89fa-82b64ca867d0 00000020:00000080:3.0:1789302665.542403:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a690590b000/8df8e325-951a-4604-89fa-82b64ca867d0 for MGC192.168.203.142@tcp 00000020:01000000:3.0:1789302665.542406:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.142@tcp (8df8e325-951a-4604-89fa-82b64ca867d0) 00000020:00000080:3.0:1789302665.542642:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6806f05800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789302665.546147:0:13391:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789302665.546156:0:13391:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789302665.546161:0:13391:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789302665.546169:0:13391:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789302665.546312:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9a693d776000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789302665.546331:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789302665.546589:0:8459:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789302665.546765:0:13086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1789302665.546879:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1789302665.547024:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a690bbc2000:5828] 0 exiting: rc = 1 00000100:00100000:3.0:1789302665.547213:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a690bbc2200:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1789302665.547821:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.548062:0:6712:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a6805020200:6712] 3 exiting: rc = 0 00000100:00100000:1.0:1789302665.548527:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a690bbc3800:5832] 2 exiting: rc = 0 00000100:00100000:1.0:1789302665.548604:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a690bbc2e00:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1789302665.548653:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a690bbc2600:5830] 0 exiting: rc = 1 00000100:00100000:2.0:1789302665.549008:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549016:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549022:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549029:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549034:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549039:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549057:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549063:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549068:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549074:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549080:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549086:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549092:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549098:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549103:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549110:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549117:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549123:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549128:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549133:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549138:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549143:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549148:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549154:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549159:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549165:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549170:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549176:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549181:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549186:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549191:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549196:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549202:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549207:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549213:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549218:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549223:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549228:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549233:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549238:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549243:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549259:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549265:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549270:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549276:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549281:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549599:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549606:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549612:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549617:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549623:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549628:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549634:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549639:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549643:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549648:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549653:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549659:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549664:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549669:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549675:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549680:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549685:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789302665.549691:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789302665.555331:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789302665.555345:0:13391:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789302665.555351:0:13391:0:(genops.c:885:class_export_put()) final put ffff9a69369fd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789302665.555355:0:13391:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69369fd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789302665.555361:0:13391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789302665.555414:0:13391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6936077800 1 00000020:00000080:2.0:1789302665.555420:0:13391:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x20be524657f11402 00000020:00000080:2.0:1789302665.555426:0:13391:0:(genops.c:885:class_export_put()) final put ffff9a6936071000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789302665.555440:0:13391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789302665.555445:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789302665.555449:0:13391:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789302665.555462:0:13391:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9a6908ca99c0) has no exports 00000020:00000080:3.0:1789302665.555632:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936071000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789302665.603639:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302665.603667:0:13391:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789302665.603673:0:13391:0:(genops.c:885:class_export_put()) final put ffff9a6936075000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789302665.603677:0:13391:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6936075000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789302665.603685:0:13391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789302665.603864:0:13391:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6936070000 00000020:01000000:3.0:1789302665.603887:0:13391:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789302665.603891:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789302665.603895:0:13391:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789302665.603898:0:13391:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9a690a590000) has no exports 00000020:00000080:3.0:1789302665.603922:0:13391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789302665.603928:0:13391:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789302665.603930:0:13391:0:(genops.c:885:class_export_put()) final put ffff9a69049f2000/OSS_uuid 00000020:00000080:3.0:1789302665.603932:0:13391:0:(genops.c:844:class_export_destroy()) destroying export ffff9a69049f2000/OSS_uuid for OSS 00000020:01000000:3.0:1789302665.603936:0:13391:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789302665.604016:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9a693c283c00:6696] 0 exiting: rc = 1 00000100:00100000:3.0:1789302665.604098:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9a6903e79000:6699] 2 exiting: rc = 0 00000100:00100000:3.0:1789302665.604148:0:10693:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9a69362d7a00:10693] 3 exiting: rc = 0 00000100:00100000:3.0:1789302665.606373:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9a6902f57800:6697] 1 exiting: rc = 0 00000100:00100000:3.0:1789302665.606466:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606474:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606480:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606485:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606490:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606494:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606499:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606504:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606509:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606514:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606520:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606524:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606530:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606535:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606540:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606560:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606565:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606571:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606586:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606591:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606596:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606601:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606606:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606618:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606624:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606629:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606633:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606638:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606644:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606648:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606652:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606666:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606673:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606678:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606683:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606688:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606693:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606697:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606702:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606706:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606711:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606716:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606721:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606727:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606732:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606738:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606743:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606751:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606757:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606762:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606776:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606781:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606785:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606793:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606798:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606802:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606807:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606812:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606817:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606823:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606827:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606832:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606837:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.606842:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789302665.608004:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a6903e79e00:6700] 0 exiting: rc = 1 00000100:00080000:0.0:1789302665.608610:0:5841:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789302665.608732:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a693c282e00:6701] 1 exiting: rc = 0 00000100:00100000:3.0:1789302665.609082:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609090:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609096:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609101:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609106:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609111:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609115:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609120:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609125:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609130:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609135:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609140:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609146:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609151:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609162:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609170:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609175:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609181:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609186:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609192:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609197:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609213:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609219:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609224:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609229:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609235:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609240:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609245:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609249:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609254:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609258:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609263:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609267:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609271:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609275:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609279:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609283:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609307:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609313:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609317:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609322:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609326:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609330:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609335:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609339:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609344:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609349:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609355:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609361:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609366:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609371:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609377:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609382:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609387:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609392:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609396:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609409:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609414:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609419:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609423:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609428:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609433:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609439:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.609449:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.610200:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a693c282600:6703] 1 exiting: rc = 0 00000100:00100000:1.0:1789302665.611380:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a693c282000:6704] 2 exiting: rc = 0 00000100:00100000:3.0:1789302665.615837:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a693c283800:6702] 0 exiting: rc = 1 00000100:00100000:3.0:1789302665.615957:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.615966:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.615972:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.615978:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.615990:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.615995:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616001:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616007:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616012:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616018:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616023:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616028:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616034:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616039:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616045:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616051:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616058:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616064:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616071:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616076:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616082:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616088:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616093:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616112:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616119:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616138:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616143:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616148:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616153:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616157:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616163:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616168:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616173:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616178:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616183:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616188:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616193:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616199:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616206:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616212:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616217:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616223:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616229:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616234:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616240:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616246:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616252:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616273:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616280:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616317:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616323:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616328:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616334:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616339:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616345:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616350:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616355:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616361:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616367:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616373:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616386:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616392:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616398:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.616404:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.622530:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a6936532a00:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1789302665.626454:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a6936532c00:6706] 1 exiting: rc = 0 00000100:00100000:3.0:1789302665.629545:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629555:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629561:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629565:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629570:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629586:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629591:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629596:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629601:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629606:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629619:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629625:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629633:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629637:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629643:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629647:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629652:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629658:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629663:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629668:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629673:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629678:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629684:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629689:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629694:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629698:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629703:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629707:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629713:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629718:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629738:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629744:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629752:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629759:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629768:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629777:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629783:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629789:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629794:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629799:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629804:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629809:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629814:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629820:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629825:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629830:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629836:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629841:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629846:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629851:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629855:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629860:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629867:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629872:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629877:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629882:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629886:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629891:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629896:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629901:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629906:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629911:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629916:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.629922:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630672:0:6707:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a693d7ef200:6707] 0 exiting: rc = 1 00000100:00100000:3.0:1789302665.630761:0:6708:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a693d7ee400:6708] 1 exiting: rc = 0 00000100:00100000:3.0:1789302665.630808:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630815:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630835:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630841:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630846:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630851:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630857:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630863:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630868:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630873:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630878:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630883:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630888:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630892:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630910:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630917:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630921:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630927:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630933:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630939:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630945:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630951:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630956:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630962:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630968:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630974:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.630994:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631001:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631007:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631013:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631019:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631025:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631031:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631037:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631051:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631057:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631063:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631069:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631091:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631098:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631103:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631108:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631115:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631120:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631125:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631131:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631138:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631145:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631150:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631156:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631176:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631185:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631190:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631197:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631203:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631208:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631212:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631218:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631223:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631229:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631234:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631242:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631249:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789302665.631263:0:13391:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789302665.654481:0:13391:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789302685.563890:0:14006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789302695.812044:0:14468:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789302695.812051:0:14468:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789302695.812199:0:14468:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a6805068800 00000020:01000004:2.0:1789302695.812218:0:14468:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789302695.812227:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789302695.812245:0:14468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a6908ca8000) 00000020:00000080:2.0:1789302695.812261:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789302695.837391:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789302695.839957:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789302695.840919:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 343: rc = 0 00100000:10000000:2.0:1789302695.841050:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 343: rc = 0 00100000:10000000:2.0:1789302695.841266:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 343: rc = 0 00100000:10000000:2.0:1789302695.841689:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789302695.841762:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 343: rc = 0 00100000:10000000:2.0:1789302695.841861:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 343: rc = 0 00100000:10000000:2.0:1789302695.841962:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 343: rc = 0 00100000:10000000:2.0:1789302695.842896:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 345: rc = 0 00100000:10000000:2.0:1789302695.843971:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 104: rc = 0 00100000:10000000:2.0:1789302695.844049:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 104: rc = 0 00100000:10000000:2.0:1789302695.844645:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1789302695.845085:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1789302695.845650:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:2.0:1789302695.845867:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:2.0:1789302695.846099:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1789302695.846413:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1789302695.846651:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1789302695.846876:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1789302695.847082:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1789302695.847325:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:2.0:1789302695.847590:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1789302695.847876:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:2.0:1789302695.848224:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 660: rc = 0 00100000:10000000:2.0:1789302695.848500:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 660: rc = 0 00100000:10000000:2.0:1789302695.848734:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 660: rc = 0 00100000:10000000:2.0:1789302695.848970:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 660: rc = 0 00100000:10000000:2.0:1789302695.849193:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 660: rc = 0 00100000:10000000:2.0:1789302695.849832:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 660: rc = 0 00100000:10000000:2.0:1789302695.850083:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 660: rc = 0 00100000:10000000:2.0:1789302695.850556:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 660: rc = 0 00100000:10000000:2.0:1789302695.850802:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 660: rc = 0 00100000:10000000:2.0:1789302695.851065:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 660: rc = 0 00100000:10000000:2.0:1789302695.851450:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 660: rc = 0 00100000:10000000:2.0:1789302695.851771:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 660: rc = 0 00100000:10000000:2.0:1789302695.852016:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 660: rc = 0 00100000:10000000:2.0:1789302695.852414:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 660: rc = 0 00100000:10000000:2.0:1789302695.852680:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 660: rc = 0 00100000:10000000:2.0:1789302695.853553:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 660: rc = 0 00100000:10000000:2.0:1789302695.853925:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 660: rc = 0 00100000:10000000:2.0:1789302695.854170:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 660: rc = 0 00100000:10000000:2.0:1789302695.854477:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 660: rc = 0 00100000:10000000:2.0:1789302695.855211:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 660: rc = 0 00100000:10000000:2.0:1789302695.855589:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 660: rc = 0 00100000:10000000:2.0:1789302695.856076:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 660: rc = 0 00100000:10000000:2.0:1789302695.856449:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 660: rc = 0 00100000:10000000:2.0:1789302695.856826:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 660: rc = 0 00100000:10000000:2.0:1789302695.857334:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 660: rc = 0 00100000:10000000:2.0:1789302695.857644:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 660: rc = 0 00100000:10000000:2.0:1789302695.858013:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 660: rc = 0 00100000:10000000:2.0:1789302695.858355:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 660: rc = 0 00100000:10000000:2.0:1789302695.858833:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 660: rc = 0 00100000:10000000:2.0:1789302695.859093:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 660: rc = 0 00100000:10000000:2.0:1789302695.859454:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 660: rc = 0 00100000:10000000:2.0:1789302695.863648:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 660: rc = 0 00100000:10000000:2.0:1789302695.864077:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 649: rc = 0 00100000:10000000:2.0:1789302695.865560:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789302695.866024:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 105: rc = 0 00100000:10000000:2.0:1789302695.866215:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789302695.866272:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 105: rc = 0 00100000:10000000:2.0:1789302695.866500:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789302695.866557:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 105: rc = 0 00100000:10000000:2.0:1789302695.867005:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789302695.867061:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 107: rc = 0 00100000:10000000:2.0:1789302695.867232:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789302695.867308:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 107: rc = 0 00100000:10000000:2.0:1789302695.867501:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789302695.867555:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 107: rc = 0 00000020:00000080:2.0:1789302695.868144:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789302695.868152:0:14468:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789302695.868168:0:14468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f12519 00000020:01000004:2.0:1789302695.868178:0:14468:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789302695.868183:0:14468:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789302695.868188:0:14468:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6805068800 from MGS 00000020:01000004:2.0:1789302695.868192:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789302695.868202:0:14468:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a6908cacd40) 00000020:00000080:2.0:1789302695.868210:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789302695.868261:0:14468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6805068800 from MGS, refs=2 00080000:01000000:2.0:1789302695.868265:0:14468:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789302695.868268:0:14468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f12527 00000100:00100000:2.0:1789302695.868941:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789302695.869880:0:14468:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789302695.869888:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789302695.871221:0:14468:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789302695.871231:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789302695.871983:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302695.872239:0:14468:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789302695.872244:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789302695.880908:0:14468:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789302695.880929:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789302695.889576:0:14468:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789302695.889592:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789302695.901871:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302695.901877:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302695.901880:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302695.902889:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302695.902893:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302695.902895:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302695.903585:0:14468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789302695.908653:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789302695.922004:0:14468:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789302695.922023:0:14468:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789302695.922026:0:14468:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789302695.930929:0:14478:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789302695.931159:0:14468:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789302695.931269:0:14468:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789302695.933184:0:14468:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789302695.933527:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302695.936928:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789302695.936938:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789302695.938426:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789302695.938438:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789302695.942122:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789302695.942137:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789302695.943770:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789302695.943793:0:14468:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.142@tcp' 00000020:01000004:1.0:1789302695.943795:0:14468:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789302695.943826:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.142@tcp (typ=mgc) 00000020:00000080:1.0:1789302695.943839:0:14468:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.142@tcp (ffff9a690a41cd40) 00000020:00000080:1.0:1789302695.943855:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789302695.943934:0:14468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a693c55b000@MGC192.168.203.142@tcp: add connection 192.168.203.142@tcp at head 00010000:00010000:1.0:1789302695.944090:0:14468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.142@tcp-0 is initialized 00000040:01000000:1.0:1789302695.944096:0:14468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789302695.944270:0:14482:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789302695.952214:0:14483:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789302695.952259:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.142@tcp (uuid 57a3ba4d-eae9-4780-ad89-641003f4f604) 00000020:00000080:1.0:1789302695.952281:0:14468:0:(genops.c:1384:class_connect()) connect: client 57a3ba4d-eae9-4780-ad89-641003f4f604, cookie 0x20be524657f12535 00000100:00080000:1.0:1789302695.952312:0:14468:0:(import.c:545:import_select_connection()) MGC192.168.203.142@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302695.952325:0:14468:0:(import.c:666:import_select_connection()) MGC192.168.203.142@tcp: import ffff9a693c55b000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789302695.952357:0:14468:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806973b80 x1876219505231872/t0(0) o250->MGC192.168.203.142@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302695.952389:0:14468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 57a3ba4d-eae9-4780-ad89-641003f4f604->MGS 00000020:01000004:1.0:1789302695.952409:0:14468:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789302695.952414:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789302695.952427:0:14468:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a690a41b380) 00000020:00000080:1.0:1789302695.952439:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789302695.955394:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57a3ba4d-eae9-4780-ad89-641003f4f604:3302:1876219505231872:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789302695.955467:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302695.959903:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505231872 00000100:00100000:0.0:1789302695.959925:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505231872 00000100:00100000:0.0:1789302695.959973:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302695.959982:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1876219505231872:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789302695.960010:0:14479:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 57a3ba4d-eae9-4780-ad89-641003f4f604@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:0.0:1789302695.960055:0:14479:0:(genops.c:1384:class_connect()) connect: client 57a3ba4d-eae9-4780-ad89-641003f4f604, cookie 0x20be524657f12543 00000100:00080000:0.0:1789302695.960193:0:14479:0:(import.c:65:import_set_state_nolock()) ffff9a68063b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302695.960277:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+5:3302:x1876219505231872:12345-0@lo:250:mount.lustre.0 Request processed in 295us (4810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302695.960304:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789302695.960370:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.142@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789302695.960380:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.142@tcp: connect to target with instance 0 00000100:00080000:0.0:1789302695.960388:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.142@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789302695.960393:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789302695.960396:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a693c55b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789302695.960398:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789302695.960406:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789302695.960411:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:57a3ba4d-eae9-4780-ad89-641003f4f604:3302:1876219505231872:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789302695.966426:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302695.966615:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789302695.966621:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789302695.968565:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789302695.968573:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789302695.968976:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302695.968984:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789302695.970118:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302695.970392:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789302695.970398:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789302695.978384:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789302695.978407:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789302696.083433:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302696.083834:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789302696.083842:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789302696.092810:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789302696.092829:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789302696.093564:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302696.093933:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302696.093940:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789302696.098843:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302696.098858:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789302696.101352:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302696.101549:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302696.101555:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789302696.103091:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789302696.103104:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789302696.104644:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302696.104827:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789302696.104832:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789302696.106003:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789302696.106013:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789302696.177674:0:14468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302696.178033:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789302696.178042:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789302696.181969:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789302696.181989:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789302696.182972:0:14468:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302696.182982:0:14468:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789302696.186585:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789302696.186613:0:14468:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789302696.186619:0:14468:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789302696.186790:0:14468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789302696.186827:0:14468:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.142@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789302696.186832:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789302696.186834:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302696.186836:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302696.186837:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302696.186839:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302696.186840:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302696.186842:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302696.186843:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302696.186845:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302696.186846:0:14468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302696.186852:0:14468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789302696.186854:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789302696.186856:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789302696.186857:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789302696.186858:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789302696.186859:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789302696.186860:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789302696.186861:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789302696.186862:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789302696.186863:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789302696.186864:0:14468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789302696.186890:0:14468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789302696.186911:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789302696.186990:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.187038:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302696.187317:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505232000 00000100:00100000:3.0:1789302696.187325:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505232000 00000100:00100000:3.0:1789302696.187375:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302696.187385:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+5:14468:x1876219505232000:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789302696.187430:0:14481:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789302696.187433:0:14481:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789302696.187436:0:14481:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789302696.187943:0:14500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789302696.188315:0:14481:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789302696.189570:0:14501:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789302696.189576:0:14501:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789302696.189580:0:14501:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789302696.189613:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789302696.189988:0:14481:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789302696.189998:0:14481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789302696.203808:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+5:14468:x1876219505232000:12345-0@lo:253:mount.lustre.0 Request processed in 16416us (16810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302696.203822:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302696.208129:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789302696.208151:0:14468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789302696.208154:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789302696.208156:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789302696.208157:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302696.208159:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302696.208160:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302696.208161:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302696.208162:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789302696.208163:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789302696.208165:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302696.208167:0:14468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789302696.208193:0:14468:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6805068800 from lustre-MDT0000 10000000:01000000:1.0:1789302696.208225:0:14468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789302696.208228:0:14468:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789302696.208233:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a690a41cd40 10000000:01000000:1.0:1789302696.208237:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789302696.208245:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a690a41cd40 from 1 10000000:01000000:1.0:1789302696.208248:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789302696.208316:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.208327:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.208355:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302696.208386:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806970000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302696.208450:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302696.208487:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906070000 going to sleep for 11 seconds 00000100:00100000:2.0:1789302696.208638:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505232128 00000100:00100000:2.0:1789302696.208645:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505232128 00000100:00100000:2.0:1789302696.208697:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302696.208716:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+5:14468:x1876219505232128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302696.208728:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302696.208743:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69033f8c00/0x20be524657f12551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1254a expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.208766:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f8c00/0x20be524657f12551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1254a expref: 6 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.208776:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69033f8c00/0x20be524657f12551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1254a expref: 6 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.208797:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8c00, rc 0) 00000100:00100000:2.0:1789302696.208844:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+6:14468:x1876219505232128:12345-0@lo:101:mount.lustre.0 Request processed in 138us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302696.208850:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789302696.209170:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806970000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302696.209185:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.209194:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302696.209248:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806970000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302696.209274:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302696.209402:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906070000 going to sleep for 11 seconds 00000100:00100000:0.0:1789302696.213936:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505232256 00000100:00100000:0.0:1789302696.213952:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505232256 00000100:00100000:1.0:1789302696.214357:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302696.214378:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+6:14468:x1876219505232256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302696.214821:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+6:14468:x1876219505232256:12345-0@lo:501:mount.lustre.0 Request processed in 444us (5544us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302696.214830:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789302696.215178:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806970000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232256:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789302696.215220:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789302696.215245:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.215256:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302696.215265:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6805068800 10000000:01000000:0.0:1789302696.215279:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789302696.215303:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a6805068800 10000000:01000000:0.0:1789302696.215306:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789302696.215310:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a6805068800 from 1 10000000:01000000:0.0:1789302696.215312:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789302696.215344:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f9e00/0x20be524657f12558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.215353:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a68049f9e00/0x20be524657f12558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.215374:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a68049f9e00/0x20be524657f12558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302696.215393:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789302696.215428:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.215457:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302696.218075:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505232384 00000100:00100000:1.0:1789302696.218091:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505232384 00000100:00100000:1.0:1789302696.218156:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302696.218167:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+6:14468:x1876219505232384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302696.218200:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302696.218224:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361ab600/0x20be524657f1255f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12558 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.218250:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361ab600/0x20be524657f1255f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12558 expref: 7 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.218261:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361ab600/0x20be524657f1255f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12558 expref: 7 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.218270:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361ab600, rc 0) 00000100:00100000:1.0:1789302696.218385:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+7:14468:x1876219505232384:12345-0@lo:101:mount.lustre.0 Request processed in 220us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302696.218392:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789302696.218498:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302696.218517:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a68049f9e00/0x20be524657f12558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1255f expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.218527:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a68049f9e00/0x20be524657f12558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1255f expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302696.218548:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789302696.218572:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f9e00/0x20be524657f12558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1255f expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.218579:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a68049f9e00/0x20be524657f12558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1255f expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302696.218595:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789302696.218599:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789302696.218604:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a6805068800 10000000:01000000:0.0:1789302696.218607:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789302696.218611:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789302696.218614:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789302696.218648:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f8600/0x20be524657f12566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.218656:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a68049f8600/0x20be524657f12566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.218665:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a68049f8600/0x20be524657f12566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302696.218684:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789302696.218883:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.218917:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302696.218980:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505232512 00000100:00100000:2.0:1789302696.218985:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505232512 00000100:00100000:2.0:1789302696.219025:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789302696.219033:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+7:14468:x1876219505232512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302696.219040:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302696.219050:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69033f9800/0x20be524657f1256d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12566 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.219063:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f9800/0x20be524657f1256d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12566 expref: 8 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.219071:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69033f9800/0x20be524657f1256d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12566 expref: 8 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.219077:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9800, rc 0) 00000100:00100000:2.0:1789302696.219116:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+8:14468:x1876219505232512:12345-0@lo:101:mount.lustre.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302696.219123:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302696.219195:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302696.219207:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a68049f8600/0x20be524657f12566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1256d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.219215:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a68049f8600/0x20be524657f12566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1256d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302696.219273:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302696.219331:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302696.219348:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6905944480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302696.219413:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505232640 00000100:00100000:0.0:1789302696.219418:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505232640 00000100:00100000:0.0:1789302696.219439:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302696.219445:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+8:14468:x1876219505232640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302696.219993:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+9:14468:x1876219505232640:12345-0@lo:501:mount.lustre.0 Request processed in 545us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302696.220001:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789302696.220096:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302696.220127:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302696.220166:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302696.220194:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6905944480 going to sleep for 11 seconds 00000100:00100000:0.0:1789302696.220248:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505232768 00000100:00100000:0.0:1789302696.220253:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505232768 00000100:00100000:0.0:1789302696.220279:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302696.220346:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+9:14468:x1876219505232768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789302696.224876:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+9:14468:x1876219505232768:12345-0@lo:503:mount.lustre.0 Request processed in 4581us (4700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302696.224891:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789302696.225191:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806193b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505232768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302696.225668:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806973800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14502:1876219505232896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302696.225742:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302696.225778:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6906070600 going to sleep for 11 seconds 00000100:00100000:2.0:1789302696.225911:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505232896 00000100:00100000:2.0:1789302696.225918:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505232896 00000100:00100000:2.0:1789302696.225964:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789302696.225972:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+9:14502:x1876219505232896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302696.226283:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+9:14502:x1876219505232896:12345-0@lo:502:llog_process_th.0 Request processed in 310us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302696.226324:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789302696.226648:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806973800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14502:1876219505232896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789302696.226678:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302696.226689:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302696.226691:0:14502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789302696.226696:0:14502:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789302696.226699:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302696.226721:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a693bb8b380) 00000020:00000080:3.0:1789302696.226738:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789302696.226744:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789302696.226826:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789302696.226835:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f1257b 00000020:00000080:3.0:1789302696.227046:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789302696.227051:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302696.227055:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302696.227057:0:14502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789302696.227059:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302696.227063:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302696.227064:0:14502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789302696.227068:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789302696.227075:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a693bb88000) 00000020:00000080:3.0:1789302696.227084:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789302696.227088:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789302696.227090:0:14502:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789302696.227092:0:14502:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789302696.227098:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789302696.227133:0:14502:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6805068800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789302696.227146:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a693bb899c0) 00000020:00000080:3.0:1789302696.227153:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789302696.227207:0:14502:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789302696.227218:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f12590 00000020:00000080:3.0:1789302696.227340:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789302696.227346:0:14502:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789302696.227350:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x20be524657f12597 00080000:01000000:3.0:1789302696.227355:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789302696.227370:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f1259e 00010000:00010000:0.0:1789302696.341279:0:14502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789302696.343883:0:14502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1789302696.344278:0:14502:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789302696.346306:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a690a418000) 00000020:00000080:1.0:1789302696.346327:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789302696.346410:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789302696.346417:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f125ac 00000020:00000080:2.0:1789302696.353514:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789302696.367033:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x20be524657f125b3 00000020:00000080:2.0:1789302696.367845:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789302696.367856:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302696.367862:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302696.367864:0:14502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789302696.367867:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789302696.367870:0:14502:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789302696.367872:0:14502:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789302696.367873:0:14502:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789302696.367875:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789302696.367877:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302696.367878:0:14502:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789302696.367881:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789302696.367885:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302696.367887:0:14502:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789302696.367891:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789302696.367925:0:14502:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789302696.367940:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302696.367943:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302696.367945:0:14502:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789302696.367947:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789302696.367951:0:14502:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789302696.367955:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302696.367957:0:14502:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789302696.367960:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789302696.367966:0:14502:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:2.0:1789302696.367997:0:14502:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789302696.368000:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302696.368015:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a6908ca99c0) 00000020:00000080:2.0:1789302696.368038:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789302696.368043:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789302696.368191:0:14502:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789302696.368197:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789302696.368204:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f125c1 00010000:00080000:2.0:1789302696.368238:0:14502:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6909c98800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789302696.369593:0:14502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1789302696.374436:0:14502:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789302696.374577:0:14502:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789302696.376843:0:14502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302696.376934:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789302696.377009:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789302696.377879:0:14506:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789302696.377885:0:14506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789302696.378926:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789302696.378938:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789302696.378971:0:14502:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789302696.378990:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f125c8 00000100:00080000:2.0:1789302696.379001:0:14502:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789302696.379013:0:14502:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6909c98800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789302696.379048:0:14502:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6807255500 x1876219505233024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302696.379131:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505233024:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789302696.379185:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219505233024 offset 0 length 520: 4 00000100:00080000:2.0:1789302696.379547:0:14502:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789302696.379663:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789302696.379668:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302696.379670:0:14502:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789302696.379673:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789302696.379676:0:14502:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789302696.379677:0:14502:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789302696.379679:0:14502:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789302696.379680:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789302696.379683:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302696.379684:0:14502:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789302696.379696:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789302696.379700:0:14502:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789302696.379704:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302696.379705:0:14502:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789302696.379708:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789302696.379711:0:14502:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.142@tcp to nid 0x20000c0a8cb8e (192.168.203.142@tcp) 00000020:01000000:2.0:1789302696.379735:0:14502:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789302696.379738:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302696.379753:0:14502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a6908cab380) 00000020:00000080:2.0:1789302696.379767:0:14502:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789302696.379772:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789302696.379833:0:14502:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789302696.379840:0:14502:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789302696.379846:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x20be524657f125d6 00010000:00080000:2.0:1789302696.379876:0:14502:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69369f9800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789302696.380323:0:14502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789302696.380557:0:14502:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789302696.380579:0:14502:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789302696.382079:0:14502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302696.382705:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789302696.382794:0:14502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789302696.383422:0:14508:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789302696.383427:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789302696.385001:0:14502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789302696.385015:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789302696.385051:0:14502:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789302696.385078:0:14502:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f125dd 00000100:00080000:1.0:1789302696.385217:0:14502:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789302696.385231:0:14502:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69369f9800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789302696.385281:0:14502:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806971880 x1876219505233152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302696.385473:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505233152:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789302696.385525:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219505233152 offset 0 length 520: 4 00000100:00080000:1.0:1789302696.385576:0:14502:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789302696.385744:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302696.385749:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.385751:0:14502:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789302696.385755:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302696.385759:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.385760:0:14502:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789302696.385763:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789302696.385765:0:14502:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789302696.385768:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302696.385770:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.385771:0:14502:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789302696.385773:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302696.385775:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.385776:0:14502:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789302696.385780:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789302696.385808:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14502:1876219505233280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302696.385855:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302696.385913:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302696.386040:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505233280 00000100:00100000:3.0:1789302696.386048:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505233280 00000100:00100000:3.0:1789302696.386244:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789302696.386255:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+9:14502:x1876219505233280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302696.386575:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+9:14502:x1876219505233280:12345-0@lo:502:llog_process_th.0 Request processed in 322us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302696.386584:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302696.386742:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14502:1876219505233280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302696.386767:0:14502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302696.386773:0:14502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.386774:0:14502:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789302696.386778:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789302696.386974:0:14468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789302696.387003:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789302696.387054:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f8600/0x20be524657f12566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1256d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.387066:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a68049f8600/0x20be524657f12566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1256d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302696.387074:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6805068800 from 1 10000000:01000000:0.0:1789302696.387078:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789302696.387230:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.387239:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.387260:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302696.387278:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789302696.387340:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.387377:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302696.387446:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505233408 00000100:00100000:1.0:1789302696.387457:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505233408 00000100:00100000:1.0:1789302696.387498:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789302696.387505:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+9:14468:x1876219505233408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302696.387514:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302696.387526:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f125e4 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.387545:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f125e4 expref: 10 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.387555:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f125e4 expref: 10 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.387562:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361ab400, rc 0) 00000100:00100000:1.0:1789302696.387592:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+10:14468:x1876219505233408:12345-0@lo:101:mount.lustre.0 Request processed in 88us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302696.387598:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302696.387902:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302696.387915:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.387924:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302696.388978:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233536:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789302696.389036:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.389413:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302696.389514:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505233536 00000100:00100000:1.0:1789302696.389521:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505233536 00000100:00100000:1.0:1789302696.389599:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789302696.389608:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+10:14468:x1876219505233536:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789302696.389697:0:14481:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789302696.389705:0:14481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789302696.389900:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+10:14468:x1876219505233536:12345-0@lo:256:mount.lustre.0 Request processed in 292us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302696.389907:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302696.389989:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233536:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789302696.391001:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789302696.391028:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.391040:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302696.391049:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6805068800 from 1 10000000:01000000:0.0:1789302696.391052:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789302696.396530:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.396545:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.396558:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302696.396586:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789302696.396953:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.397053:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302696.397225:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505233664 00000100:00100000:2.0:1789302696.397234:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505233664 00000100:00100000:2.0:1789302696.397510:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789302696.397522:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+10:14468:x1876219505233664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302696.397536:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302696.397553:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f125f2 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.397579:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f125f2 expref: 11 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.397610:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f125f2 expref: 11 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.397619:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9e00, rc 0) 00000100:00100000:2.0:1789302696.397867:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14468:x1876219505233664:12345-0@lo:101:mount.lustre.0 Request processed in 347us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302696.397875:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302696.397950:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302696.397966:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.397976:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302696.398038:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302696.398069:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.398260:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302696.398414:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505233792 00000100:00100000:1.0:1789302696.398421:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505233792 00000100:00100000:1.0:1789302696.398496:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302696.398513:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14468:x1876219505233792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302696.398996:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14468:x1876219505233792:12345-0@lo:501:mount.lustre.0 Request processed in 483us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302696.399005:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302696.399211:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302696.399253:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789302696.399376:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.399443:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302696.399499:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505233920 00000100:00100000:1.0:1789302696.399504:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505233920 00000100:00100000:1.0:1789302696.399570:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302696.399578:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14468:x1876219505233920:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302696.399801:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14468:x1876219505233920:12345-0@lo:503:mount.lustre.0 Request processed in 224us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302696.399808:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302696.399875:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505233920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789302696.407619:0:14510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14510:1876219505234048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302696.407783:0:14510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.407865:0:14510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6904008900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302696.408023:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505234048 00000100:00100000:3.0:1789302696.408030:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505234048 00000100:00100000:3.0:1789302696.408081:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789302696.408267:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14510:x1876219505234048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789302696.408991:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14510:x1876219505234048:12345-0@lo:502:llog_process_th.0 Request processed in 899us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302696.409002:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302696.409223:0:14510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14510:1876219505234048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789302696.409252:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302696.409262:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302696.409264:0:14510:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789302696.409271:0:14510:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6805068800 00000020:00000080:0.0:1789302696.409274:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302696.409281:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302696.409388:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302696.409390:0:14510:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789302696.409394:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302696.409553:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.409556:0:14510:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789302696.409563:0:14510:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6805068800 00000020:00000080:1.0:1789302696.409565:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302696.409739:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302696.409744:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.409745:0:14510:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789302696.409748:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302696.409751:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.409752:0:14510:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302696.409756:0:14510:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6805068800 00000020:00000080:1.0:1789302696.409758:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789302696.417609:0:14510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14510:1876219505234176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302696.417708:0:14510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302696.417760:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505234176 00000100:00100000:1.0:1789302696.417768:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505234176 00000100:00100000:1.0:1789302696.427571:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789302696.427596:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14510:x1876219505234176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789302696.431208:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14510:x1876219505234176:12345-0@lo:502:llog_process_th.0 Request processed in 3614us (13490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302696.431223:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789302696.431323:0:14510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab540 going to sleep for 11 seconds 00000100:00100000:1.0:1789302696.431352:0:14510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14510:1876219505234176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789302696.431397:0:14510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302696.431406:0:14510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302696.431408:0:14510:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789302696.431415:0:14510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789302696.434805:0:14468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789302696.434844:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789302696.434863:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.434876:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302696.434934:0:14468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789302696.434938:0:14468:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6805068800 10000000:01000000:2.0:1789302696.434941:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6805068800 10000000:01000000:2.0:1789302696.434945:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302696.434951:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6805068800 from 1 10000000:01000000:2.0:1789302696.434954:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789302696.434988:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9400/0x20be524657f12600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.434995:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69033f9400/0x20be524657f12600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.435005:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69033f9400/0x20be524657f12600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302696.435039:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505234304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789302696.435112:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302696.435158:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302696.436799:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505234304 00000100:00100000:3.0:1789302696.436812:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505234304 00000100:00100000:3.0:1789302696.436861:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789302696.436871:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14468:x1876219505234304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302696.436888:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302696.436907:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba7600/0x20be524657f12607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12600 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.436930:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7600/0x20be524657f12607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12600 expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.436949:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba7600/0x20be524657f12607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12600 expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.436958:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7600, rc 0) 00000100:00100000:3.0:1789302696.437015:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14468:x1876219505234304:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302696.437021:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302696.438457:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505234304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302696.438482:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69033f9400/0x20be524657f12600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12607 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.438493:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69033f9400/0x20be524657f12600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f12607 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302696.438566:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505234432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302696.438612:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302696.438660:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302696.438787:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505234432 00000100:00100000:0.0:1789302696.438793:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505234432 00000100:00100000:0.0:1789302696.438838:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789302696.438847:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14468:x1876219505234432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302696.439097:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14468:x1876219505234432:12345-0@lo:501:mount.lustre.0 Request processed in 251us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302696.439104:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789302696.439657:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505234432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302696.439695:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505234560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302696.439737:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302696.439755:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033e2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789302696.439769:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505234560 00000100:00100000:2.0:1789302696.439773:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505234560 00000100:00100000:2.0:1789302696.439812:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302696.439819:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14468:x1876219505234560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302696.439965:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14468:x1876219505234560:12345-0@lo:503:mount.lustre.0 Request processed in 146us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302696.439973:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789302696.440016:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505234560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302696.441586:0:14514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14514:1876219505234688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302696.441727:0:14514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302696.441763:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505234688 00000100:00100000:2.0:1789302696.441770:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505234688 00000100:00100000:2.0:1789302696.441803:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302696.441811:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14514:x1876219505234688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302696.442038:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14514:x1876219505234688:12345-0@lo:502:llog_process_th.0 Request processed in 227us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302696.442046:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789302696.442096:0:14514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033e29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302696.442113:0:14514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14514:1876219505234688:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789302696.442172:0:14514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789302696.442194:0:14514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a690476b380) 00000020:00000080:2.0:1789302696.442212:0:14514:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789302696.442280:0:14514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6805068800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789302696.442308:0:14514:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6805068800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789302696.442311:0:14514:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6805068800 4 00010000:00080000:2.0:1789302696.442337:0:14514:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a69362e5000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.142@tcp at head 00010000:00010000:2.0:1789302696.453120:0:14514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789302696.453350:0:14514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789302696.453409:0:14514:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789302696.453423:0:14514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x20be524657f12615 00000100:00080000:2.0:1789302696.453432:0:14514:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789302696.453445:0:14514:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a69362e5000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789302696.453735:0:14514:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6807255c00 x1876219505234816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789302696.453774:0:14514:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789302696.453870:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505234816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789302696.453936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302696.455458:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505234816 00000100:00100000:2.0:1789302696.455470:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505234816 00000100:00100000:2.0:1789302696.455676:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302696.455685:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505234816:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789302696.455780:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505234816:12345-0@lo:38:llog_process_th.0 Request processed in 94us (1842us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789302696.455788:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302696.455851:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302696.455859:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69362e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302696.455863:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789302696.455867:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505234816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789302696.468958:0:14514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14514:1876219505234944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789302696.469047:0:14514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302696.469172:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505234944 00000100:00100000:0.0:1789302696.469181:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505234944 00000100:00100000:0.0:1789302696.469232:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789302696.469242:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14514:x1876219505234944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789302696.469613:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14514:x1876219505234944:12345-0@lo:502:llog_process_th.0 Request processed in 372us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302696.469698:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789302696.469792:0:14514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789302696.469816:0:14514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:57a3ba4d-eae9-4780-ad89-641003f4f604:14514:1876219505234944:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789302696.469848:0:14514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789302696.469919:0:14468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789302696.469938:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789302696.469960:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9400/0x20be524657f12600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12607 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.469971:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69033f9400/0x20be524657f12600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12607 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789302696.470018:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789302696.470023:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302696.470024:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302696.470026:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302696.470027:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302696.470028:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302696.470029:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302696.470030:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302696.470032:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302696.470033:0:14468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302696.470036:0:14468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789302696.470038:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302696.470039:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789302696.470040:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302696.470040:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302696.470041:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302696.470042:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302696.470043:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789302696.470044:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789302696.470044:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302696.470045:0:14468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789302696.470061:0:14468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789302696.470074:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505235072:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789302696.470178:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302696.470196:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789302696.470214:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505235072 00000100:00100000:2.0:1789302696.470218:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505235072 00000100:00100000:2.0:1789302696.470246:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789302696.470253:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14468:x1876219505235072:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789302696.470306:0:14480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789302696.470320:0:14480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789302696.540943:0:14480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789302696.540964:0:14480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789302696.541017:0:14500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789302696.541022:0:14500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789302696.541044:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.541063:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f125e4 expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.541084:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.541127:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f125e4 expref: 12 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302696.541143:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f125e4 expref: 12 pid: 14479 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302696.541159:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876219505235200:0@lo:104: 00000100:00100000:2.0:1789302696.541227:0:14500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302696.541338:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693c5e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302696.543195:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505235200 00000100:00100000:1.0:1789302696.543209:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505235200 00000100:00100000:1.0:1789302696.543252:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302696.543260:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57a3ba4d-eae9-4780-ad89-641003f4f604+3:14500:x1876219505235200:12345-0@lo:104: 00010000:00010000:1.0:1789302696.543277:0:14469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.543390:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789302696.543396:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57a3ba4d-eae9-4780-ad89-641003f4f604+3:14500:x1876219505235200:12345-0@lo:104: Request processed in 137us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302696.543413:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789302696.543434:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302696.543440:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.543447:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:1.0:1789302696.543451:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.543475:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789302696.543482:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302696.543489:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789302696.543524:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.543531:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789302696.543551:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.543559:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a68049f9000/0x20be524657f125e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f125eb expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302696.543575:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302696.543577:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302696.543578:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302696.543608:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57a3ba4d-eae9-4780-ad89-641003f4f604:3303:1876219505235328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302696.543816:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302696.543896:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876219505235200:0@lo:104: 00010000:00010000:1.0:1789302696.543917:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302696.543986:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505235328 00000100:00100000:3.0:1789302696.543991:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505235328 00010000:00010000:3.0:1789302696.544013:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f125e4 expref: 13 pid: 14479 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302696.544042:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302696.544049:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57a3ba4d-eae9-4780-ad89-641003f4f604+13:3303:x1876219505235328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302696.544061:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302696.544066:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f125e4 expref: 13 pid: 14479 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544078:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f125e4 expref: 13 pid: 14479 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544091:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69361ab400/0x20be524657f125eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f125e4 expref: 13 pid: 14479 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544103:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544123:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789302696.544140:0:14471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003118076s 00010000:00010000:3.0:1789302696.544145:0:14471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544152:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544158:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544165:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544171:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302696.544175:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544183:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544195:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302696.544205:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302696.544237:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:3303:x1876219505235328:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302696.544244:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302696.544617:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57a3ba4d-eae9-4780-ad89-641003f4f604:3303:1876219505235328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302696.544729:0:14500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.544737:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302696.544744:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69033f8800/0x20be524657f1261c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302696.550438:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14468:x1876219505235072:12345-0@lo:253:mount.lustre.0 Request processed in 80176us (80251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302696.550453:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789302696.550565:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:14468:1876219505235072:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789302696.550580:0:14468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789302696.550584:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789302696.550586:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789302696.550587:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302696.550589:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302696.550590:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302696.550592:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302696.550593:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789302696.550594:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789302696.550596:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302696.550597:0:14468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789302696.550615:0:14468:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789302696.562427:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789302696.563161:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789302696.565012:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789302696.565181:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789302696.565499:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789302696.565883:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789302696.570083:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302696.570247:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789302696.571352:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789302696.571769:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789302696.572053:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789302696.572214:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789302696.616512:0:14468:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789302696.618186:0:14468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789302696.618262:0:14523:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789302696.618266:0:14523:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789302696.618663:0:14524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789302696.618765:0:14524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789302696.620998:0:14524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789302696.621073:0:14524:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789302696.621078:0:14524:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789302696.622790:0:14468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789302696.622908:0:14468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789302696.623398:0:14468:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789302696.623407:0:14468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789302696.623534:0:14468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302696.633272:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789302696.633893:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789302696.633929:0:14468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789302696.641040:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789302696.655512:0:14468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789302696.717180:0:14468:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789302696.717216:0:14468:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae4640d87988 00100000:10000000:3.0:1789302696.717223:0:14468:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789302696.718795:0:14468:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789302696.718813:0:14468:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789302696.718826:0:14468:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789302696.718853:0:14468:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789302696.909990:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789302697.231928:0:14483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789302697.231936:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6805068800 from 6 10000000:01000000:1.0:1789302697.231941:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789302697.231995:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302697.232074:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302697.232087:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302697.232114:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505235456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302697.232177:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302697.232307:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789302697.234139:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505235456 00000100:00100000:0.0:1789302697.234152:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505235456 00000100:00100000:1.0:1789302697.234281:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302697.234314:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14483:x1876219505235456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302697.234333:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302697.234351:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12623 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302697.234392:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12623 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302697.234485:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12623 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302697.234495:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aa800, rc 0) 00000100:00100000:1.0:1789302697.234577:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14483:x1876219505235456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (2399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302697.234597:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789302697.235546:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505235456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302697.235571:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302697.235582:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302697.235652:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505235584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789302697.235703:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302697.235757:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693671cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302697.235863:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505235584 00000100:00100000:3.0:1789302697.235870:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505235584 00000100:00100000:3.0:1789302697.235914:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789302697.235922:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14483:x1876219505235584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789302697.238214:0:14480:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789302697.238240:0:14480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789302697.238244:0:14480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789302697.238419:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14483:x1876219505235584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2494us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302697.238435:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789302697.238789:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505235584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789302697.238849:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789302697.238860:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302697.238871:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302697.485935:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789302697.934496:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302698.510932:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789302698.957547:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302699.981480:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302701.005525:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302701.966846:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302701.966852:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302701.966855:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302701.966857:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302701.966860:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789302701.966863:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789302701.966867:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a69362e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789302701.966884:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a69362e5000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789302701.966905:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806192d80 x1876219505235840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789302701.966931:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302701.966943:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57a3ba4d-eae9-4780-ad89-641003f4f604:3303:1876219505235712:0@lo:400:kworker.0 00000100:00100000:3.0:1789302701.967010:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302701.967069:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505235712 00000100:00100000:3.0:1789302701.967075:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505235712 00000100:00100000:3.0:1789302701.967117:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302701.967126:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:3303:x1876219505235712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302701.967176:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:3303:x1876219505235712:12345-0@lo:400:kworker.0 Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302701.967183:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789302701.967232:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57a3ba4d-eae9-4780-ad89-641003f4f604:3303:1876219505235712:0@lo:400:kworker.0 00000100:00100000:3.0:1789302701.972472:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505235840:0@lo:38:kworker.0 00000100:00100000:3.0:1789302701.972573:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302701.972725:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505235840 00000100:00100000:1.0:1789302701.972734:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505235840 00000100:00100000:1.0:1789302701.972776:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302701.972791:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1876219505235840:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789302701.972820:0:14486:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:1.0:1789302701.972863:0:14486:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x20be524657f12631 00000004:00100000:1.0:1789302701.972881:0:14486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789302701.973019:0:14486:0:(import.c:65:import_set_state_nolock()) ffff9a693d773800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302701.973078:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876219505235840:12345-0@lo:38:kworker.0 Request processed in 286us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302701.973086:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789302701.973500:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6806192d80 x1876219505235840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789302701.973517:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789302701.973526:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789302701.973532:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789302701.973535:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69362e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789302701.973542:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876219505235840:0@lo:38:kworker.0 00000001:02000400:0.0:1789302702.007602:0:14767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789302702.029849:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302703.053924:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302704.077670:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789302704.992562:0:14917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8af02260 20000000:00000080:2.0:1789302704.992581:0:14917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6904743400 uarg=0000000000000000 20000000:01000000:2.0:1789302704.992617:0:14917:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789302704.992624:0:14917:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789302704.992629:0:14917:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789302704.996175:0:14918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789302704.996372:0:14917:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789302705.007952:0:14917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789302705.007983:0:14917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.008003:0:14917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f125f2 expref: 11 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.008012:0:14917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.008056:0:14917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f125f2 expref: 11 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.008071:0:14917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f125f2 expref: 11 pid: 14480 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302705.008087:0:14917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806192d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14917:1876219505235968:0@lo:104: 00000100:00100000:3.0:1789302705.008154:0:14917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302705.008265:0:14917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690422a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789302705.009088:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505235968 00000100:00100000:3.0:1789302705.009098:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505235968 00000100:00100000:3.0:1789302705.009192:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302705.009201:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+3:14917:x1876219505235968:12345-0@lo:104: 00010000:00010000:3.0:1789302705.009224:0:14470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.009342:0:14470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302705.009348:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+3:14917:x1876219505235968:12345-0@lo:104: Request processed in 150us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302705.009356:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302705.009432:0:14917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806192d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14917:1876219505235968:0@lo:104: 00010000:00010000:2.0:1789302705.009454:0:14917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.009815:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302705.009822:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.009830:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8400 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302705.009835:0:14474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.009844:0:14474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302705.009852:0:14474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302705.009858:0:14474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302705.009929:0:14474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.009937:0:14474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302705.009980:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.009988:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a68049f8400/0x20be524657f125f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f125f9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010006:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302705.010009:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302705.010011:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302705.010034:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302705.010045:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57a3ba4d-eae9-4780-ad89-641003f4f604:3306:1876219505236096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302705.010083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302705.010125:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505236096 00000100:00100000:3.0:1789302705.010130:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505236096 00010000:00010000:3.0:1789302705.010150:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f125f2 expref: 12 pid: 14480 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302705.010172:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302705.010179:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:3306:x1876219505236096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302705.010192:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302705.010197:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f125f2 expref: 12 pid: 14480 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010206:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f125f2 expref: 12 pid: 14480 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010419:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69033f9e00/0x20be524657f125f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f125f2 expref: 12 pid: 14480 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010432:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010446:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010461:0:14471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010594:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010601:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010608:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010613:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302705.010618:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.010624:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302705.011990:0:14917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302705.012006:0:14917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.012365:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.012376:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7800/0x20be524657f12638 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302705.012395:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302705.013254:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57a3ba4d-eae9-4780-ad89-641003f4f604+11:3306:x1876219505236096:12345-0@lo:103:ldlm_bl.0 Request processed in 3069us (3163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302705.013276:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302705.013637:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57a3ba4d-eae9-4780-ad89-641003f4f604:3306:1876219505236096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789302705.107097:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302706.065792:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302696/real 1789302696] req@ffff9a6806971880 x1876219505233152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302706 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302706.065830:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6806971880 x1876219505233152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302706 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302706.065843:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302696/real 1789302696] req@ffff9a6807255500 x1876219505233024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302706 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302706.065856:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6807255500 x1876219505233024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302706 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789302706.065878:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302706.065908:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789302706.065912:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505233152:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789302706.065918:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a6909c98800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302706.065924:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789302706.065927:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505233024:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789302706.066055:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302706.066060:0:14031:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789302706.066064:0:14031:0:(import.c:65:import_set_state_nolock()) ffff9a6909c98800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789302706.066070:0:14031:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:2.0:1789302706.066076:0:14031:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789302706.066090:0:14031:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6909c98800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789302706.066115:0:14031:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6807257800 x1876219505236352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789302706.066130:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789302706.066133:0:14031:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789302706.066135:0:14031:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789302706.066139:0:14031:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:2.0:1789302706.066142:0:14031:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789302706.066146:0:14031:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69369f9800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:2.0:1789302706.066157:0:14031:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6807257b80 x1876219505236480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302706.066198:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302706.066213:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505236224:0@lo:400:kworker.0 00000100:00100000:2.0:1789302706.066325:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302706.066594:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505236608:0@lo:400:kworker.0 00000100:00100000:3.0:1789302706.066635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302706.067043:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505236608 00000100:00100000:3.0:1789302706.067054:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505236608 00000100:00100000:3.0:1789302706.067113:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789302706.067123:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505236608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302706.067194:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505236608:12345-0@lo:400:kworker.0 Request processed in 71us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302706.067203:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302706.067641:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505236352:0@lo:8:kworker.0 00000100:00100000:1.0:1789302706.067737:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505236224 00000100:00100000:1.0:1789302706.067744:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505236224 00000100:00100000:1.0:1789302706.067780:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789302706.067788:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+11:3305:x1876219505236224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302706.067837:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+11:3305:x1876219505236224:12345-0@lo:400:kworker.0 Request processed in 50us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302706.067844:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789302706.067899:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505236224:0@lo:400:kworker.0 00000400:00000100:2.0:1789302706.067965:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219505236352 offset 0 length 520: 4 00000100:00100000:2.0:1789302706.067981:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505236480:0@lo:8:kworker.0 00000400:00000100:2.0:1789302706.068024:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876219505236480 offset 0 length 520: 4 00010000:00080000:3.0:1789302706.070827:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6807255500 x1876219505236608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302706.070850:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505236608:0@lo:400:kworker.0 00010000:00010000:3.0:1789302706.130546:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789302706.445420:0:14483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789302706.445461:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6805068800 from 10 10000000:01000000:2.0:1789302706.445469:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302706.445532:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302706.445547:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302706.445561:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302706.445594:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505236736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302706.445688:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302706.445809:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789302706.446086:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505236736 00000100:00100000:3.0:1789302706.446096:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505236736 00000100:00100000:3.0:1789302706.446316:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302706.446337:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+11:14483:x1876219505236736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789302706.446356:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302706.446375:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1263f expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302706.446404:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1263f expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302706.446416:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1263f expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302706.446446:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7800, rc 0) 00000100:00100000:3.0:1789302706.446511:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14483:x1876219505236736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302706.446519:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789302706.446610:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505236736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302706.446628:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302706.446639:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302706.446714:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505236864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302706.446746:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302706.447128:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302706.447216:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505236864 00000100:00100000:1.0:1789302706.447222:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505236864 00000100:00100000:1.0:1789302706.447260:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789302706.447267:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14483:x1876219505236864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302706.447627:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14483:x1876219505236864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 360us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302706.447634:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789302706.447731:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505236864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302706.447774:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505236992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302706.447825:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302706.447859:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302706.448083:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505236992 00000100:00100000:1.0:1789302706.448089:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505236992 00000100:00100000:1.0:1789302706.448115:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789302706.448122:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14483:x1876219505236992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302706.448336:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:14483:x1876219505236992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302706.448344:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789302706.448478:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505236992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789302706.449712:0:14978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789302706.451484:0:14483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789302706.451532:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302706.451549:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302706.451565:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302707.150753:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302708.177393:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789302708.750130:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789302709.202459:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789302709.939898:0:15166:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789302709.939904:0:15166:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789302709.940036:0:15166:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a693639b000 00000020:01000004:1.0:1789302709.940055:0:15166:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789302709.940070:0:15166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789302709.940090:0:15166:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a690a4199c0) 00000020:00000080:1.0:1789302709.940111:0:15166:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789302709.955501:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789302709.955818:0:15166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789302709.957096:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789302709.958828:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789302709.959686:0:15166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789302709.960105:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:1.0:1789302709.960332:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 515: rc = 0 00100000:10000000:1.0:1789302709.960434:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 515: rc = 0 00100000:10000000:1.0:1789302709.960981:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 896: rc = 0 00100000:10000000:1.0:1789302709.961235:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 896: rc = 0 00100000:10000000:1.0:1789302709.961551:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 896: rc = 0 00100000:10000000:1.0:1789302709.961806:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 896: rc = 0 00100000:10000000:1.0:1789302709.962050:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 896: rc = 0 00100000:10000000:1.0:1789302709.962360:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 896: rc = 0 00000020:00000080:1.0:1789302709.964325:0:15166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789302709.964343:0:15166:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789302709.964357:0:15166:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x20be524657f12654 00000020:01000004:1.0:1789302709.964368:0:15166:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789302709.964394:0:15166:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789302709.964398:0:15166:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789302709.964405:0:15166:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789302709.964410:0:15166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789302709.964424:0:15166:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a690a590000) 00000020:00000080:1.0:1789302709.964436:0:15166:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789302709.970808:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789302709.971714:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789302709.971721:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789302709.975715:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789302709.975728:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789302709.984078:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302709.984096:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789302709.986802:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302709.986984:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789302709.986990:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789302709.990335:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789302709.990355:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789302710.020234:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789302710.020633:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789302710.020641:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789302710.030199:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789302710.030219:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789302710.031216:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789302710.031224:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789302710.032947:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789302710.033137:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789302710.033143:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789302710.033899:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789302710.033906:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789302710.097504:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789302710.097808:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789302710.097815:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789302710.099478:0:15166:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789302710.099490:0:15166:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789302710.099883:0:15166:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789302710.099906:0:15166:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789302710.099912:0:15166:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789302710.133776:0:15166:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789302710.133819:0:15166:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.142@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789302710.133823:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789302710.133824:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789302710.133825:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302710.133826:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302710.133827:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302710.133828:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302710.133829:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302710.133831:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302710.133832:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789302710.133836:0:15166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789302710.133837:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789302710.133839:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789302710.133840:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302710.133841:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302710.133842:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302710.133842:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302710.133843:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302710.133844:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302710.133845:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789302710.133868:0:15166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789302710.133888:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237120:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789302710.133958:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302710.134566:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.137026:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505237120 00000100:00100000:0.0:1789302710.137039:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505237120 00000100:00100000:0.0:1789302710.137147:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789302710.137157:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:15166:x1876219505237120:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789302710.137201:0:14479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789302710.137205:0:14479:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789302710.137208:0:14479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789302710.147975:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:15166:x1876219505237120:12345-0@lo:253:mount.lustre.0 Request processed in 10811us (14008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.147989:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789302710.148005:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237120:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789302710.148019:0:15166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789302710.148022:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789302710.148036:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789302710.148037:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302710.148039:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302710.148040:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302710.148042:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302710.148043:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302710.148045:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302710.148046:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789302710.148065:0:15166:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a693639b000 from lustre-OST0000 10000000:01000000:1.0:1789302710.148093:0:15166:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789302710.148097:0:15166:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789302710.148103:0:15166:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a690a41cd40 local copy 00010000:00010000:1.0:1789302710.148114:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302710.148447:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302710.148482:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302710.148521:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.148638:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505237248 00000100:00100000:0.0:1789302710.148645:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505237248 00000100:00100000:0.0:1789302710.148691:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789302710.148700:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:15166:x1876219505237248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302710.148863:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+12:15166:x1876219505237248:12345-0@lo:501:mount.lustre.0 Request processed in 163us (380us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302710.148871:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789302710.148961:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237248:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789302710.148974:0:15166:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789302710.149119:0:15166:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789302710.149125:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.149131:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302710.149147:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a693639b000 10000000:01000000:1.0:1789302710.149150:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789302710.149154:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a690a41cd40 10000000:01000000:1.0:1789302710.149155:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789302710.149161:0:15166:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a690a41cd40 from 1 10000000:01000000:1.0:1789302710.149163:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789302710.149258:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361abe00/0x20be524657f12662 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.149314:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69361abe00/0x20be524657f12662 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.149324:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69361abe00/0x20be524657f12662 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302710.149340:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302710.149369:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302710.149388:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.149445:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505237376 00000100:00100000:0.0:1789302710.149450:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505237376 00000100:00100000:0.0:1789302710.149484:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789302710.149492:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+12:15166:x1876219505237376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302710.149510:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302710.149524:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f8200/0x20be524657f12669 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12662 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.149620:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f8200/0x20be524657f12669 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12662 expref: 13 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.149632:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f8200/0x20be524657f12669 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12662 expref: 13 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.149641:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8200, rc 0) 00000100:00100000:0.0:1789302710.149681:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+13:15166:x1876219505237376:12345-0@lo:101:mount.lustre.0 Request processed in 189us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.149687:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789302710.149766:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302710.149780:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69361abe00/0x20be524657f12662 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12669 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.149789:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69361abe00/0x20be524657f12662 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f12669 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302710.149803:0:15166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789302710.149827:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361abe00/0x20be524657f12662 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12669 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.149835:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361abe00/0x20be524657f12662 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12669 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302710.149841:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789302710.149850:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789302710.149855:0:15166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789302710.149857:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789302710.149873:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aa600/0x20be524657f12670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.149880:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69361aa600/0x20be524657f12670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.149898:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69361aa600/0x20be524657f12670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302710.149911:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789302710.149935:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302710.149955:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69394c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.150078:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505237504 00000100:00100000:0.0:1789302710.150083:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505237504 00000100:00100000:0.0:1789302710.150112:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789302710.150119:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+13:15166:x1876219505237504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302710.150127:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302710.150135:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f9400/0x20be524657f12677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12670 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.150149:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f9400/0x20be524657f12677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12670 expref: 14 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.150157:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f9400/0x20be524657f12677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12670 expref: 14 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.150164:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9400, rc 0) 00000100:00100000:0.0:1789302710.150219:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505237504:12345-0@lo:101:mount.lustre.0 Request processed in 100us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.150225:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789302710.150499:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302710.150513:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69361aa600/0x20be524657f12670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12677 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.150521:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69361aa600/0x20be524657f12670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f12677 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302710.151156:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789302710.152030:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302710.152656:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789302710.152705:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789302710.152741:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789302710.152792:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789302710.152830:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789302710.152864:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789302710.152932:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789302710.152940:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789302710.153023:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302710.153093:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.153393:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.153725:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505237632 00000100:00100000:0.0:1789302710.153734:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505237632 00000100:00100000:0.0:1789302710.153817:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789302710.153827:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505237632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302710.154188:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505237632:12345-0@lo:501:mount.lustre.0 Request processed in 362us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.154196:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789302710.154280:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302710.154364:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302710.154406:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.154764:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1789302710.154855:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505237760 00000100:00100000:1.0:1789302710.154861:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505237760 00000100:00100000:3.0:1789302710.155034:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789302710.155042:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505237760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302710.155503:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505237760:12345-0@lo:503:mount.lustre.0 Request processed in 461us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302710.155511:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789302710.155645:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237760:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789302710.156808:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302710.157431:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302710.157506:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.157674:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302710.157760:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505237888 00000100:00100000:3.0:1789302710.157768:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505237888 00000100:00100000:3.0:1789302710.157818:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789302710.158013:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505237888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302710.158641:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505237888:12345-0@lo:502:mount.lustre.0 Request processed in 629us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302710.158715:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505237888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302710.159047:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789302710.159218:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789302710.159254:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000100:00100000:3.0:1789302710.159407:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000040:00080000:2.0:1789302710.159649:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789302710.159772:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789302710.159810:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789302710.160080:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789302710.160190:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789302710.160231:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789302710.160392:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789302710.160513:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789302710.160648:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789302710.160762:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302710.160841:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302710.161035:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505238016 00000100:00100000:3.0:1789302710.161044:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505238016 00000100:00100000:3.0:1789302710.161094:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789302710.161102:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505238016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302710.161189:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789302710.161781:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505238016:12345-0@lo:502:mount.lustre.0 Request processed in 678us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302710.161796:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789302710.162003:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302710.162091:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789302710.162104:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789302710.165389:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789302710.165402:0:15180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789302710.165410:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789302710.165412:0:15180:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789302710.165419:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789302710.165436:0:15180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a6904768000) 00000020:00000080:2.0:1789302710.165459:0:15180:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789302710.165465:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789302710.165528:0:15180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a693639b000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789302710.165537:0:15180:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789302710.165545:0:15180:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x20be524657f12685 00010000:00010000:3.0:1789302710.173496:0:15180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789302710.174242:0:15180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789302710.179498:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789302710.182225:0:15180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789302710.182237:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302710.182244:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302710.182246:0:15180:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789302710.182250:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789302710.182252:0:15180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789302710.182254:0:15180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302710.182256:0:15180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789302710.182258:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789302710.182261:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302710.182274:0:15180:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789302710.182278:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302710.182283:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302710.182314:0:15180:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789302710.182320:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789302710.182322:0:15180:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789302710.182325:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302710.182328:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302710.182329:0:15180:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789302710.182332:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789302710.182334:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302710.182336:0:15180:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789302710.182340:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789302710.182417:0:15180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789302710.182421:0:15180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789302710.182423:0:15180:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789302710.182427:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789302710.182592:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789302710.182621:0:15166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789302710.182641:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aa600/0x20be524657f12670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12677 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.182653:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361aa600/0x20be524657f12670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12677 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302710.182671:0:15166:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a693639b000 from 1 10000000:01000000:2.0:1789302710.182675:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789302710.182715:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.182723:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.182749:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302710.182775:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789302710.182855:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.182899:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.183340:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505238144 00000100:00100000:0.0:1789302710.183349:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505238144 00000100:00100000:0.0:1789302710.183401:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789302710.183410:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+14:15166:x1876219505238144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302710.183423:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302710.183435:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1268c expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.183456:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1268c expref: 15 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.183484:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1268c expref: 15 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.183492:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9600, rc 0) 00000100:00100000:0.0:1789302710.183534:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238144:12345-0@lo:101:mount.lustre.0 Request processed in 125us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.183540:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789302710.184352:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302710.184375:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.184385:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302710.184911:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789302710.185656:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302710.185887:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789302710.185931:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789302710.185991:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789302710.185999:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789302710.186074:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302710.186138:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.186185:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302710.186466:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505238272 00000100:00100000:3.0:1789302710.186480:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505238272 00000100:00100000:3.0:1789302710.186524:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789302710.186534:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302710.186755:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238272:12345-0@lo:501:mount.lustre.0 Request processed in 223us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302710.186763:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789302710.189440:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302710.189515:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302710.189593:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.189632:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.192991:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505238400 00000100:00100000:0.0:1789302710.193006:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505238400 00000100:00100000:0.0:1789302710.193065:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789302710.193075:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789302710.193357:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238400:12345-0@lo:503:mount.lustre.0 Request processed in 283us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.193365:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789302710.193539:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789302710.194023:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302710.194103:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302710.194158:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.194213:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.198426:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505238528 00000100:00100000:0.0:1789302710.198441:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505238528 00000100:00100000:0.0:1789302710.198502:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789302710.198512:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302710.198779:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238528:12345-0@lo:502:mount.lustre.0 Request processed in 269us (4621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.198788:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789302710.198909:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302710.199234:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789302710.199333:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789302710.199386:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789302710.199423:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789302710.199453:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789302710.199509:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789302710.199549:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789302710.199582:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789302710.199621:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302710.199668:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.199699:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68049cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.199919:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505238656 00000100:00100000:0.0:1789302710.199925:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505238656 00000100:00100000:0.0:1789302710.199968:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789302710.199976:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302710.200144:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238656:12345-0@lo:502:mount.lustre.0 Request processed in 168us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.200151:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789302710.200597:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302710.200703:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789302710.200715:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789302710.205139:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302710.205154:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302710.205157:0:15184:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789302710.205163:0:15184:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a693639b000 00000020:00000080:0.0:1789302710.205166:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302710.205173:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302710.205176:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302710.205187:0:15184:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789302710.205190:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302710.205193:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302710.205195:0:15184:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789302710.205198:0:15184:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a693639b000 00000020:00000080:0.0:1789302710.205200:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302710.205257:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302710.205271:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302710.205273:0:15184:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789302710.205276:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789302710.205279:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302710.205280:0:15184:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789302710.205313:0:15184:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a693639b000 00000020:00000080:0.0:1789302710.205316:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302710.205375:0:15184:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302710.205379:0:15184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302710.205380:0:15184:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789302710.205384:0:15184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789302710.205584:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789302710.205610:0:15166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789302710.205633:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.205645:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302710.205691:0:15166:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789302710.205693:0:15166:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a693639b000 10000000:01000000:3.0:1789302710.205696:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a693639b000 10000000:01000000:3.0:1789302710.205700:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789302710.205705:0:15166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a693639b000 from 1 10000000:01000000:3.0:1789302710.205708:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789302710.205741:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1269a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.205749:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1269a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.205760:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1269a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302710.205783:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789302710.205858:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302710.205901:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6905944cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302710.207531:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505238784 00000100:00100000:1.0:1789302710.207541:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505238784 00000100:00100000:1.0:1789302710.207590:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789302710.207600:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505238784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302710.207614:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302710.207630:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361aac00/0x20be524657f126a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f1269a expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.207654:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361aac00/0x20be524657f126a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f1269a expref: 16 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.207664:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361aac00/0x20be524657f126a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1269a expref: 16 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302710.207684:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aac00, rc 0) 00000100:00100000:1.0:1789302710.207744:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505238784:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302710.207750:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789302710.207880:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302710.207896:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1269a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f126a1 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.207905:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1269a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f126a1 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302710.208669:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789302710.208975:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302710.209249:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789302710.209350:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00010000:00010000:3.0:1789302710.229178:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789302710.229337:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789302710.229456:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789302710.229502:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789302710.229553:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789302710.229589:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789302710.229621:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789302710.229669:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789302710.229706:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789302710.229740:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789302710.229789:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789302710.229825:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789302710.229859:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789302710.229910:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789302710.229972:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789302710.230006:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789302710.230079:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789302710.230119:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789302710.230164:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789302710.230212:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789302710.230248:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789302710.230332:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789302710.230387:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789302710.230426:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789302710.230460:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789302710.230528:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789302710.230567:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789302710.230662:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789302710.230671:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789302710.234762:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302710.234831:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302710.235171:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505238912 00000100:00100000:0.0:1789302710.235180:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505238912 00000100:00100000:0.0:1789302710.235224:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789302710.235231:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505238912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789302710.235556:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505238912:12345-0@lo:501:mount.lustre.0 Request processed in 324us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.235564:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789302710.237631:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6905944cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302710.237668:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505238912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302710.237719:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505239040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302710.237790:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302710.237827:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6905944cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302710.238778:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505239040 00000100:00100000:1.0:1789302710.238788:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505239040 00000100:00100000:1.0:1789302710.238837:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789302710.238846:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505239040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302710.239081:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505239040:12345-0@lo:503:mount.lustre.0 Request processed in 235us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302710.239088:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789302710.239401:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505239040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789302710.240019:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789302710.240118:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505239168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302710.240178:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302710.244656:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6905944cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302710.246785:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505239168 00000100:00100000:1.0:1789302710.246800:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505239168 00000100:00100000:1.0:1789302710.246856:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789302710.246867:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505239168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302710.247247:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505239168:12345-0@lo:502:mount.lustre.0 Request processed in 382us (7069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302710.247255:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789302710.248973:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505239168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789302710.249363:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789302710.250754:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789302710.250826:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789302710.251156:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789302710.251216:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789302710.251701:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789302710.251771:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789302710.251815:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789302710.251866:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789302710.251995:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789302710.252033:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789302710.252088:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789302710.252135:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789302710.252197:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789302710.252985:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789302710.253047:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789302710.253084:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789302710.253139:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789302710.253179:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789302710.253235:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789302710.253334:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789302710.253597:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789302710.253649:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789302710.253734:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789302710.253800:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789302710.254434:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789302710.254498:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789302710.254772:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789302710.254890:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789302710.254979:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789302710.255018:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789302710.255054:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789302710.255092:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789302710.255148:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789302710.255189:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789302710.257186:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789302710.257720:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789302710.257760:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789302710.258357:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789302710.258409:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789302710.258458:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505239296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302710.258727:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.258775:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6903eab9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302710.258775:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505239296 00000100:00100000:1.0:1789302710.258784:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505239296 00000100:00100000:1.0:1789302710.259063:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789302710.259074:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505239296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302710.259371:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505239296:12345-0@lo:502:mount.lustre.0 Request processed in 299us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302710.259381:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789302710.259393:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505239296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302710.259475:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789302710.259487:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789302710.265675:0:15189:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789302710.265693:0:15189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a693d7699c0) 00000020:00000080:0.0:1789302710.265717:0:15189:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789302710.265785:0:15189:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a693639b000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789302710.265789:0:15189:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a693639b000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789302710.265791:0:15189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a693639b000 3 00010000:00080000:0.0:1789302710.265823:0:15189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6906c75000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.142@tcp at head 00010000:00010000:0.0:1789302710.267710:0:15189:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789302710.268012:0:15189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789302710.268053:0:15189:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789302710.268065:0:15189:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x20be524657f126af 00000100:00080000:0.0:1789302710.268075:0:15189:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789302710.268087:0:15189:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6906c75000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789302710.268123:0:15189:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68053d9500 x1876219505239424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789302710.268211:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876219505239424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789302710.268302:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789302710.268426:0:15189:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789302710.268451:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302710.268455:0:14031:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302710.268458:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302710.268461:0:14031:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789302710.268643:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505239424 00000100:00100000:3.0:1789302710.268651:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505239424 00000100:00100000:3.0:1789302710.268689:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302710.268698:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1876219505239424:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789302710.268722:0:14484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:3.0:1789302710.268758:0:14484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x20be524657f126b6 00000004:00100000:3.0:1789302710.268771:0:14484:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789302710.268800:0:14484:0:(import.c:65:import_set_state_nolock()) ffff9a6904a4d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302710.268914:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876219505239424:12345-0@lo:38:llog_process_th.0 Request processed in 215us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302710.268921:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302710.268943:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302710.268953:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505239552:0@lo:400:kworker.0 00000100:00100000:3.0:1789302710.268981:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789302710.269093:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68053d9500 x1876219505239424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302710.269104:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302710.269112:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789302710.269119:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789302710.269123:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789302710.269125:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a6906c75000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789302710.269130:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1876219505239424:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789302710.269697:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505239552 00000100:00100000:0.0:1789302710.269704:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505239552 00000100:00100000:0.0:1789302710.269870:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302710.269879:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505239552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302710.269946:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505239552:12345-0@lo:400:kworker.0 Request processed in 68us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.269953:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789302710.270015:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68053db480 x1876219505239552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789302710.270026:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505239552:0@lo:400:kworker.0 00000040:00080000:0.0:1789302710.270455:0:15189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789302710.270740:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789302710.270765:0:15166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789302710.270810:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1269a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f126a1 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.270819:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba7200/0x20be524657f1269a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f126a1 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789302710.270862:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789302710.270865:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789302710.270866:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302710.270868:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302710.270869:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302710.270870:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302710.270871:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302710.270873:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302710.270875:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789302710.270879:0:15166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789302710.270881:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789302710.270883:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789302710.270884:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302710.270885:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302710.270886:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302710.270892:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302710.270893:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302710.270894:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302710.270895:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789302710.270914:0:15166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789302710.270931:0:15166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806193480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505239680:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789302710.270977:0:15166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302710.271015:0:15166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6905944600 going to sleep for 11 seconds 00000100:00100000:2.0:1789302710.271064:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505239680 00000100:00100000:2.0:1789302710.271071:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505239680 00000100:00100000:2.0:1789302710.271136:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789302710.271144:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15166:x1876219505239680:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789302710.271166:0:14480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789302710.271179:0:14480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789302710.303525:0:14480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789302710.303543:0:14480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789302710.303947:0:14500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789302710.303952:0:14500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789302710.303972:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.303990:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12623 expref: 16 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.303998:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.304033:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f12623 expref: 16 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.304048:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f12623 expref: 16 pid: 14481 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302710.304061:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876219505239808:0@lo:104: 00000100:00100000:2.0:1789302710.304126:0:14500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.304174:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902fa1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302710.304412:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505239808 00000100:00100000:0.0:1789302710.304421:0:14469:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505239808 00000100:00100000:0.0:1789302710.304462:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789302710.304470:0:14469:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57a3ba4d-eae9-4780-ad89-641003f4f604+3:14500:x1876219505239808:12345-0@lo:104: 00010000:00010000:0.0:1789302710.304484:0:14469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.304536:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789302710.304542:0:14469:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:57a3ba4d-eae9-4780-ad89-641003f4f604+3:14500:x1876219505239808:12345-0@lo:104: Request processed in 73us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302710.304549:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789302710.304581:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302710.304587:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.304594:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361ab000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:0.0:1789302710.304598:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.304606:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789302710.304613:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302710.304618:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789302710.304644:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.304650:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789302710.304668:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.304674:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69361ab000/0x20be524657f12623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f1262a expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302710.304690:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302710.304691:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302710.304693:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302710.304714:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505239936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302710.304741:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302710.305192:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876219505239808:0@lo:104: 00010000:00010000:2.0:1789302710.305211:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302710.305356:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505239936 00000100:00100000:3.0:1789302710.305361:0:14473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505239936 00010000:00010000:3.0:1789302710.305384:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f12623 expref: 17 pid: 14481 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302710.305410:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302710.305417:0:14473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+17:3305:x1876219505239936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302710.305427:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302710.305432:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f12623 expref: 17 pid: 14481 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305443:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f12623 expref: 17 pid: 14481 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305457:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69361aa800/0x20be524657f1262a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f12623 expref: 17 pid: 14481 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305470:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305479:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789302710.305494:0:14473:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003118076s 00010000:00010000:3.0:1789302710.305505:0:14473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305513:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305520:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305527:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305533:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302710.305537:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305545:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305557:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302710.305566:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302710.305604:0:14473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+16:3305:x1876219505239936:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302710.305611:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302710.305641:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505239936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302710.305829:0:14500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.305837:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302710.305844:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69033f9e00/0x20be524657f126bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302710.311148:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+15:15166:x1876219505239680:12345-0@lo:253:mount.lustre.0 Request processed in 39996us (40162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302710.311163:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789302710.311257:0:15166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806193480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15166:1876219505239680:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789302710.311317:0:15166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789302710.311320:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789302710.311334:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789302710.311336:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302710.311337:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302710.311339:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302710.311340:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302710.311341:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302710.311343:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302710.311344:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789302710.311358:0:15166:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789302710.316909:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302710.317077:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789302710.317233:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302710.317807:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789302710.317945:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302710.318152:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789302710.318963:0:15166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789302710.363677:0:15166:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789302710.363686:0:15166:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789302710.363719:0:15166:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789302710.363780:0:15166:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789302710.363795:0:15166:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789302710.363825:0:15166:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789302711.247527:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789302712.144532:0:14483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789302712.144541:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6805068800 from 7 10000000:01000000:2.0:1789302712.144546:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789302712.144593:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302712.144606:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302712.144617:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302712.144641:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505240064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789302712.144707:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302712.145426:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902fa1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302712.150263:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505240064 00000100:00100000:1.0:1789302712.150300:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505240064 00000100:00100000:1.0:1789302712.155537:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789302712.155570:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+15:14483:x1876219505240064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302712.155587:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302712.155607:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f126c4 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302712.155635:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f126c4 expref: 16 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302712.155646:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f126c4 expref: 16 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302712.155654:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361ab400, rc 0) 00000100:00100000:1.0:1789302712.155735:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:14483:x1876219505240064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (11027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302712.155742:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789302712.157499:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505240064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302712.157526:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302712.157538:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302712.157606:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505240192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789302712.157661:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302712.157697:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902fa1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302712.157767:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505240192 00000100:00100000:1.0:1789302712.157774:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505240192 00000100:00100000:1.0:1789302712.157820:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302712.157828:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:14483:x1876219505240192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789302712.157845:0:14480:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789302712.157860:0:14480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789302712.157863:0:14480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789302712.157944:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:14483:x1876219505240192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302712.157952:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789302712.157984:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505240192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789302712.158049:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789302712.158057:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302712.158066:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302712.269526:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302713.300110:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302714.323941:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789302715.277463:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302715.277472:0:14031:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789302715.277476:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302715.277478:0:14031:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789302715.277548:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505240448:0@lo:400:kworker.0 00000100:00100000:0.0:1789302715.277647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302715.277724:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302715.277731:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505240576:0@lo:400:kworker.0 00000100:00100000:0.0:1789302715.277763:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302715.277853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57a3ba4d-eae9-4780-ad89-641003f4f604:3306:1876219505240320:0@lo:400:kworker.0 00000100:00100000:3.0:1789302715.277908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302715.277963:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505240448 00000100:00100000:3.0:1789302715.277973:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505240448 00000100:00100000:3.0:1789302715.278027:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505240576 00000100:00100000:3.0:1789302715.278030:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505240576 00000100:00100000:3.0:1789302715.278061:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302715.278071:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505240448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302715.278134:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505240448:12345-0@lo:400:kworker.0 Request processed in 64us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302715.278149:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302715.278168:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302715.278175:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505240576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302715.278202:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505240576:12345-0@lo:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302715.278207:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789302715.278259:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789302715.278322:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68053dbb80 x1876219505240576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302715.278339:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505240576:0@lo:400:kworker.0 00010000:00080000:3.0:1789302715.278352:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68053db800 x1876219505240448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302715.278362:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505240448:0@lo:400:kworker.0 00000100:00100000:0.0:1789302715.278499:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505240320 00000100:00100000:0.0:1789302715.278504:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505240320 00000100:00100000:0.0:1789302715.278541:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789302715.278548:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:3306:x1876219505240320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302715.278584:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:3306:x1876219505240320:12345-0@lo:400:kworker.0 Request processed in 37us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302715.278590:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789302715.278673:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57a3ba4d-eae9-4780-ad89-641003f4f604:3306:1876219505240320:0@lo:400:kworker.0 00010000:00010000:1.0:1789302715.346560:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302716.369517:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789302716.870905:0:15535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789302717.389552:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302718.414635:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789302718.991642:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789302719.437865:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789302720.407341:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302720.407347:0:14031:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789302720.407350:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789302720.407353:0:14031:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789302720.407405:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505240960:0@lo:400:kworker.0 00000100:00100000:1.0:1789302720.407405:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505240704:0@lo:400:kworker.0 00000100:00100000:2.0:1789302720.407476:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505240832:0@lo:400:kworker.0 00000100:00100000:3.0:1789302720.417548:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302720.417592:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302720.417599:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505240960 00000100:00100000:3.0:1789302720.417608:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505240960 00000100:00100000:1.0:1789302720.417652:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505240704 00000100:00100000:1.0:1789302720.417655:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505240704 00000100:00100000:3.0:1789302720.417672:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302720.417682:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505240960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302720.417697:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789302720.417703:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+16:3305:x1876219505240704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302720.417731:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505240960:12345-0@lo:400:kworker.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302720.417732:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+16:3305:x1876219505240704:12345-0@lo:400:kworker.0 Request processed in 30us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302720.417739:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789302720.417739:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789302720.417760:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302720.417785:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505240704:0@lo:400:kworker.0 00000100:00100000:2.0:1789302720.420503:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302720.420590:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505240832 00000100:00100000:1.0:1789302720.420600:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505240832 00000100:00100000:1.0:1789302720.420653:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302720.420662:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505240832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302720.420726:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505240832:12345-0@lo:400:kworker.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302720.420744:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789302720.420787:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806190a80 x1876219505240832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302720.420800:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505240832:0@lo:400:kworker.0 00010000:00080000:3.0:1789302720.423465:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806191f80 x1876219505240960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302720.423484:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505240960:0@lo:400:kworker.0 00010000:00010000:1.0:1789302720.461840:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.488125:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302721.553167:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302706/real 1789302706] req@ffff9a6807257800 x1876219505236352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302721 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302721.553209:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6807257800 x1876219505236352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302721 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302721.553220:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789302706/real 1789302706] req@ffff9a6807257b80 x1876219505236480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302721 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302721.555005:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6807257b80 x1876219505236480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789302721 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789302721.555025:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a6909c98800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302721.555047:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789302721.555052:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505236352:0@lo:8:kworker.0 00000100:00080000:0.0:1789302721.555057:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789302721.555062:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789302721.555065:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505236480:0@lo:8:kworker.0 00000100:00080000:1.0:1789302721.557179:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302721.557195:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789302721.557199:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a6909c98800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302721.557206:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1789302721.557212:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789302721.557223:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6909c98800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789302721.557562:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505241088:0@lo:400:kworker.0 00000100:00100000:0.0:1789302721.557634:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302721.558092:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806971180 x1876219505241216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789302721.558113:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302721.558116:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789302721.558119:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302721.558121:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1789302721.558124:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789302721.558129:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69369f9800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789302721.558140:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806972680 x1876219505241344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302721.558193:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505241216:0@lo:8:kworker.0 00000100:00100000:3.0:1789302721.558566:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505241088 00000100:00100000:3.0:1789302721.558574:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505241088 00000100:00100000:3.0:1789302721.558620:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789302721.558630:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:3304:x1876219505241088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302721.558700:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302721.558764:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505241216 00000100:00100000:2.0:1789302721.558769:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505241216 00000100:00100000:2.0:1789302721.558789:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302721.558794:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1876219505241216:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789302721.558817:0:15168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1789302721.558842:0:15168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f126d2 00000100:00100000:3.0:1789302721.562947:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:3304:x1876219505241088:12345-0@lo:400:kworker.0 Request processed in 4310us (5305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302721.562963:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789302721.566153:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505241088:0@lo:400:kworker.0 00000100:00100000:0.0:1789302721.566360:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505241472:0@lo:400:kworker.0 00000100:00100000:0.0:1789302721.566425:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302721.566473:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302721.566482:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505241600:0@lo:400:kworker.0 00000100:00100000:0.0:1789302721.566504:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302721.566542:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505241472 00000100:00100000:0.0:1789302721.566548:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505241472 00000100:00100000:0.0:1789302721.566589:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505241600 00000100:00100000:0.0:1789302721.566592:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505241600 00000100:00100000:0.0:1789302721.566610:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302721.566619:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505241472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302721.566671:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505241472:12345-0@lo:400:kworker.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302721.566687:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302721.566705:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302721.566712:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505241600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302721.566744:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505241600:12345-0@lo:400:kworker.0 Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302721.566750:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789302721.566781:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806970380 x1876219505241600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302721.566793:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505241600:0@lo:400:kworker.0 00010000:00080000:0.0:1789302721.566802:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806972d80 x1876219505241472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302721.566809:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505241472:0@lo:400:kworker.0 00000100:00100000:1.0:1789302721.567463:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505241344:0@lo:8:kworker.0 00000100:00100000:1.0:1789302721.567503:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302721.568101:0:15170:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789302721.568112:0:15170:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789302721.568244:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505241344 00000100:00100000:0.0:1789302721.568252:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505241344 00000100:00100000:0.0:1789302721.568554:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302721.568561:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3302:x1876219505241344:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789302721.568581:0:15728:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789302721.568637:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3302:x1876219505241344:12345-0@lo:8:kworker.0 Request processed in 75us (1133us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789302721.568644:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789302721.568776:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789302721.568781:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789302721.568785:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505241344:0@lo:8:kworker.0 00002000:00100000:2.0:1789302721.569317:0:15168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a6906130000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789302721.569325:0:15168:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789302721.569327:0:15168:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789302721.569696:0:15168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789302721.569728:0:15168:0:(import.c:65:import_set_state_nolock()) ffff9a6906135000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302721.569796:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876219505241216:12345-0@lo:8:kworker.0 Request processed in 10999us (11094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302721.569814:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789302721.570581:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806971180 x1876219505241216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302721.570593:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302721.570601:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789302721.570657:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789302721.570663:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789302721.570666:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a6909c98800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789302721.570687:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789302721.570693:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505241216:0@lo:8:kworker.0 00000004:00080000:3.0:1789302721.571118:0:14507:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789302721.571141:0:14507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806191500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14507:1876219505241856:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789302721.571207:0:14507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302721.571244:0:14507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693671cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302721.571258:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302721.571266:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505241728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302721.571317:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302721.571358:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505241856 00000100:00100000:3.0:1789302721.571365:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505241856 00000100:00100000:3.0:1789302721.571415:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302721.571436:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14507:x1876219505241856:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789302721.572120:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505241728 00000100:00100000:1.0:1789302721.572126:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505241728 00000100:00100000:1.0:1789302721.572156:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302721.572163:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876219505241728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302721.572201:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302721.572255:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876219505241728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302721.572262:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1789302721.573218:0:14506:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789302721.573668:0:14506:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432759381054ns, next at 0ns, rc = 0 00000100:00080000:3.0:1789302721.576096:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789302721.576152:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806191f80 x1876219505241728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302721.576177:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505241728:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789302721.581434:0:15170:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789302721.581457:0:15170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789302721.581463:0:15170:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1789302721.603116:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.603129:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.603147:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.603152:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.603157:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.603175:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.603198:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.603206:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.606392:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302721.606523:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302721.606533:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.606559:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.606564:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.606574:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.606595:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.606603:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea8b19a8/0x20be524657f126d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.606621:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.606623:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.606625:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.606936:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.606944:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.606956:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.606960:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.606966:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.606978:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.606986:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.606994:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607015:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789302721.607404:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.607410:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607419:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.607427:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.607431:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607440:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607448:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607455:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607467:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789302721.607834:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.607840:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607849:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.607852:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.607856:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607865:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607873:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607885:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.607893:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789302721.608937:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789302721.608947:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.608958:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302721.608963:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.608972:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.608992:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.608999:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024cc8819/0x20be524657f126e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609018:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302721.609021:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609027:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302721.609030:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609046:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609055:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609062:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004699461a/0x20be524657f126e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609074:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302721.609077:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609083:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302721.609086:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609093:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609100:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609107:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c5480b9/0x20be524657f126ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.609127:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302721.609129:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302721.609130:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.609460:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.610024:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.610033:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610045:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.610049:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.610054:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610065:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610074:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610081:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610097:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302721.610107:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302721.610111:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610124:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302721.610127:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610134:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610146:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610152:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f126f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.610166:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.610167:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.610169:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.611369:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.611379:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611392:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.611395:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.611399:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611411:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611426:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611433:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611454:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302721.611466:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302721.611471:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611477:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302721.611480:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611487:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611574:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611583:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f126fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.611835:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.611843:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.611845:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.612318:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.612325:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612335:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.612339:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.612343:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612354:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612362:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612368:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612384:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302721.612393:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302721.612397:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612404:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7400 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302721.612408:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612427:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612439:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612447:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12703 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.612461:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.612462:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.612464:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.613129:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.613136:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.613145:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.613148:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.613152:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.613161:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.613170:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.620025:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.620101:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789302721.623302:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.623316:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.623333:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.623338:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.623345:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.623358:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.623368:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.623376:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627864:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302721.627877:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627890:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6600 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302721.627895:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627905:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627924:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627931:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001808e1b4/0x20be524657f1270a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627956:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302721.627960:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627965:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302721.627978:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627986:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.627996:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.628003:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302721.628004:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302721.628006:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.628260:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789302721.628268:0:15170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f12711 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.628591:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.629242:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.629250:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.629263:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.629267:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.629273:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.630743:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.630764:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.630773:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.630800:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302721.631061:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302721.631069:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631089:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302721.631094:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631102:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631125:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631132:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097ec5c44/0x20be524657f12718 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631151:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.631153:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.631154:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.631375:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.631382:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.631392:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.631396:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.631408:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.631420:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.631429:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.631436:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.631459:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302721.631590:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302721.631595:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631603:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302721.631606:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631614:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631631:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631638:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a70fc35/0x20be524657f1271f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.631654:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.631655:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.631657:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.636304:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.636318:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.636335:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.636340:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.636346:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.636360:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.636371:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.636393:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.636422:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789302721.637281:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.637312:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637322:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.637326:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.637330:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637340:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637348:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637355:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637376:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789302721.637392:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302721.637397:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637412:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302721.637416:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637425:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637443:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637451:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637468:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302721.637471:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637477:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302721.637480:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.637487:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.640621:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.640726:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f1272d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.640753:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.640755:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.640757:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.641593:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302721.642165:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.642175:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.642200:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.642204:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.642211:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.645197:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.645630:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.645643:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.645746:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302721.646406:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.646414:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.646427:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.646432:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.646438:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.646467:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.646476:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.646484:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.649313:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302721.649327:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.649351:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.649356:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.649384:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.649408:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.649415:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093aa8493/0x20be524657f12734 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.649435:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302721.649439:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.651080:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8400 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.651086:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.651097:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.651115:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.651126:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.651128:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.651138:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789302721.652033:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789302721.653858:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302721.653874:0:15170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d28c922/0x20be524657f1273b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.654063:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302721.656249:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.656260:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.656305:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.656311:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.656318:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.656344:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.656355:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.656363:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.656382:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302721.657089:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302721.657097:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.657107:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.657111:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.657121:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.657139:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.657146:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040be6ffb/0x20be524657f12742 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.657165:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.657166:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.657168:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302721.657930:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.657938:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.657950:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.657954:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.657959:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.657970:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.658533:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.658540:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.658598:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302721.659786:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.659798:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.659811:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.659815:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.659820:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.659832:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.659841:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.659848:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.665901:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302721.665916:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.665929:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9200 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.665934:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.665964:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.665997:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.666005:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c74b9cc2/0x20be524657f12749 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.666029:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302721.666033:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.666040:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.666043:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.666050:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.666059:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.666066:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.666068:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.666090:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.672845:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302721.672858:0:15170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f8290eb/0x20be524657f12750 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.673020:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302721.685921:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.685933:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.685950:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.685954:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.685960:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.687028:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.687048:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.687057:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.687136:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302721.687728:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.687735:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.687753:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.687758:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.687763:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.687775:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.687785:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.687794:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.691895:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302721.691908:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.691922:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.691926:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.691938:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.691959:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.691967:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f243a725/0x20be524657f12757 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.692003:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302721.692007:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.692014:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.692017:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.692036:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.692048:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.692056:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.692057:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.692059:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.700951:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302721.700981:0:15170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d309ef01/0x20be524657f1275e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302721.703422:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.703438:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.703646:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.703651:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.703658:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.703685:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.703696:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.703704:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.703844:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302721.703852:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.703860:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.703865:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.703874:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.703890:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.703899:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.703901:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.703903:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.709030:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302721.709048:0:15170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c563d761/0x20be524657f12765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302721.712015:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302721.712027:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.712043:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1789302721.712047:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302721.712053:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.712067:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.712548:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.712557:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.712633:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302721.712641:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.712648:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302721.712653:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.712662:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.712679:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302721.712687:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.712688:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302721.712690:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.717811:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302721.717825:0:15170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb990f82/0x20be524657f1276c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.717884:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789302721.718568:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789302721.718577:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.718602:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1789302721.718607:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302721.718613:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.718627:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.718638:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.718658:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.718682:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789302721.719054:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789302721.719061:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719062:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302721.719068:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.719069:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1789302721.719073:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302721.719078:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.719088:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719088:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302721.719093:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.719097:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719102:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.719103:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.719117:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302721.719119:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719125:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aa5eedb/0x20be524657f12773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719147:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302721.719150:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719157:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302721.719160:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719168:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719178:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719196:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d4fe160/0x20be524657f1277a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302721.719208:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.719209:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302721.719211:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.721169:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.723783:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.723795:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723811:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.723816:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.723822:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723837:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723846:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723854:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723884:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789302721.723896:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302721.723902:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723909:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302721.723913:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723922:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723937:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723944:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4bf8146/0x20be524657f12781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.723960:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.723961:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.723963:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.724407:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.724412:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724421:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.724428:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.724433:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724444:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724453:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724459:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724476:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789302721.724849:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.724855:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724863:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.724866:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.724869:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724877:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724885:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724899:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724916:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789302721.724926:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302721.724930:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724936:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302721.724940:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724946:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724958:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724965:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015f8b9ea/0x20be524657f12788 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724979:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302721.724982:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.724998:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6200 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302721.725002:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.725009:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.725019:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.725027:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069805798/0x20be524657f1278f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.725040:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.725041:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302721.725043:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302721.726404:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789302721.727153:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789302721.727164:0:15170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.727179:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789302721.727194:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302721.727201:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.727214:0:15170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.727231:0:15170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.727239:0:15170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302721.727268:0:15170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789302721.727701:0:15170:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1789302721.727793:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14507:x1876219505241856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 156356us (156583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302721.727802:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302721.727859:0:14507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806191500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14507:1876219505241856:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789302721.727874:0:14507:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789302721.727920:0:14507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806191500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14507:1876219505241984:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789302721.727951:0:14507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302721.727995:0:14507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693671cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302721.728013:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505241984 00000100:00100000:3.0:1789302721.728019:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505241984 00000100:00100000:3.0:1789302721.728053:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302721.728060:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14507:x1876219505241984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789302721.728095:0:15168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1789302721.729911:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302721.729922:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.729943:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7400 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302721.729948:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.729958:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.729977:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.729985:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c42183e5/0x20be524657f12796 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302721.730010:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302721.730012:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302721.730014:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302721.740754:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14507:x1876219505241984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12687us (12795us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789302721.740766:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302721.742574:0:14507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806191500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14507:1876219505241984:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789302721.742596:0:14507:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1789302722.512515:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302723.534459:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302724.557600:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789302724.941901:0:15886:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789302724.941905:0:15886:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789302724.942050:0:15886:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a69369ec800 00000020:01000004:1.0:1789302724.942065:0:15886:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789302724.942077:0:15886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789302724.942089:0:15886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a690a593380) 00000020:00000080:1.0:1789302724.942106:0:15886:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789302725.033226:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789302725.035081:0:15886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789302725.040783:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789302725.055274:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789302725.056742:0:15886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789302725.059715:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 465: rc = 0 00100000:10000000:1.0:1789302725.059819:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 465: rc = 0 00100000:10000000:1.0:1789302725.059982:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 465: rc = 0 00100000:10000000:1.0:1789302725.061619:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:1.0:1789302725.064156:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 775: rc = 0 00100000:10000000:1.0:1789302725.064695:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1789302725.068675:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:2.0:1789302725.070460:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 775: rc = 0 00100000:10000000:2.0:1789302725.070765:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 775: rc = 0 00000020:00000080:2.0:1789302725.074059:0:15886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789302725.074084:0:15886:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789302725.074095:0:15886:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x20be524657f127a4 00000020:01000004:2.0:1789302725.074105:0:15886:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789302725.074126:0:15886:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.142@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789302725.074130:0:15886:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.142@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789302725.074136:0:15886:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789302725.074173:0:15886:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789302725.074177:0:15886:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.142@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789302725.100596:0:15886:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.142@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789302725.100640:0:15886:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.142@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789302725.100645:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789302725.100647:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302725.100649:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302725.100650:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302725.100651:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302725.100653:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302725.100654:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302725.100656:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302725.100657:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302725.100661:0:15886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789302725.100664:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789302725.100665:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302725.100666:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302725.100667:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302725.100668:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302725.100669:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302725.100670:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302725.100672:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302725.100673:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789302725.100702:0:15886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789302725.100725:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242112:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789302725.100800:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.100877:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302725.101077:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505242112 00000100:00100000:1.0:1789302725.101086:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505242112 00000100:00100000:1.0:1789302725.101142:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789302725.101152:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15886:x1876219505242112:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789302725.101193:0:14480:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789302725.101196:0:14480:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789302725.101200:0:14480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789302725.138256:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15886:x1876219505242112:12345-0@lo:253:mount.lustre.0 Request processed in 37096us (37445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302725.138271:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789302725.138479:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789302725.138497:0:15886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789302725.138515:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789302725.138517:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789302725.138519:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789302725.138520:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789302725.138521:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789302725.138522:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789302725.138524:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789302725.138525:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789302725.138527:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789302725.138548:0:15886:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a69369ec800 from lustre-OST0001 10000000:01000000:2.0:1789302725.138574:0:15886:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789302725.138577:0:15886:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789302725.138584:0:15886:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a690a41cd40 local copy 00010000:00010000:2.0:1789302725.138595:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302725.138855:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302725.138895:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.138940:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302725.139053:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505242240 00000100:00100000:3.0:1789302725.139060:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505242240 00000100:00100000:3.0:1789302725.139096:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789302725.139111:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15886:x1876219505242240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302725.145329:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15886:x1876219505242240:12345-0@lo:501:mount.lustre.0 Request processed in 6208us (6423us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789302725.145345:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789302725.145623:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242240:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789302725.145649:0:15886:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.142@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789302725.145920:0:15886:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.142@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789302725.145930:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.145941:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361aa200/0x20be524657f1254a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12551 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789302725.146038:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a69369ec800 10000000:01000000:2.0:1789302725.146044:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789302725.146049:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789302725.146060:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789302725.146065:0:15886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789302725.146068:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789302725.146100:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f8200/0x20be524657f127ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.146108:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69033f8200/0x20be524657f127ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.146119:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69033f8200/0x20be524657f127ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302725.146140:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789302725.147066:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.147114:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302725.147266:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505242368 00000100:00100000:0.0:1789302725.147298:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505242368 00000100:00100000:0.0:1789302725.147396:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789302725.147406:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+16:15886:x1876219505242368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302725.147418:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302725.147432:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f9c00/0x20be524657f127b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f127ab expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.147454:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f9c00/0x20be524657f127b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f127ab expref: 17 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.147463:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f9c00/0x20be524657f127b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f127ab expref: 17 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.147471:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9c00, rc 0) 00000100:00100000:0.0:1789302725.147522:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242368:12345-0@lo:101:mount.lustre.0 Request processed in 118us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302725.147528:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789302725.147600:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789302725.147614:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69033f8200/0x20be524657f127ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127b2 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.147624:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69033f8200/0x20be524657f127ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f127b2 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302725.148261:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789302725.149006:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302725.149239:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789302725.149335:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789302725.149367:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789302725.149406:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789302725.149435:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789302725.149460:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789302725.149523:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789302725.149530:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789302725.149592:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302725.149639:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.162483:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302725.163082:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505242496 00000100:00100000:1.0:1789302725.163093:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505242496 00000100:00100000:1.0:1789302725.163150:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789302725.163171:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302725.163661:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242496:12345-0@lo:501:mount.lustre.0 Request processed in 502us (14020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.163670:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789302725.163883:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302725.163935:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302725.163996:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.164026:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302725.164313:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505242624 00000100:00100000:1.0:1789302725.164318:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505242624 00000100:00100000:1.0:1789302725.164341:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789302725.164348:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242624:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302725.164795:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242624:12345-0@lo:503:mount.lustre.0 Request processed in 445us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.164812:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789302725.165096:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789302725.165837:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789302725.165908:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302725.166098:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.166129:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302725.166213:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505242752 00000100:00100000:0.0:1789302725.166219:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505242752 00000100:00100000:0.0:1789302725.166251:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789302725.166258:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302725.166475:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242752:12345-0@lo:502:mount.lustre.0 Request processed in 217us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302725.166483:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789302725.167119:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302725.167399:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789302725.167450:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789302725.167485:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789302725.167537:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789302725.167577:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789302725.167612:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789302725.167660:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789302725.167714:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789302725.167765:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789302725.167799:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302725.167847:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.167884:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302725.168116:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505242880 00000100:00100000:0.0:1789302725.168122:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505242880 00000100:00100000:0.0:1789302725.168172:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789302725.168179:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789302725.168409:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505242880:12345-0@lo:502:mount.lustre.0 Request processed in 230us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302725.168416:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789302725.170196:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505242880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789302725.170349:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789302725.170364:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789302725.171768:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789302725.171779:0:15887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789302725.171786:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.171788:0:15887:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789302725.171793:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789302725.171808:0:15887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a690a594d40) 00000020:00000080:1.0:1789302725.171833:0:15887:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789302725.171839:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789302725.171926:0:15887:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69369ec800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789302725.171934:0:15887:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789302725.171941:0:15887:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x20be524657f127c0 00010000:00010000:1.0:1789302725.175109:0:15887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789302725.183734:0:15887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1789302725.187917:0:15887:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789302725.204736:0:15887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789302725.204747:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302725.204754:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.204756:0:15887:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789302725.204760:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302725.204765:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.204767:0:15887:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789302725.204770:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789302725.204772:0:15887:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789302725.204774:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302725.204776:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.204778:0:15887:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789302725.204780:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302725.204782:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.204784:0:15887:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789302725.204788:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789302725.204852:0:15887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302725.204863:0:15887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.204864:0:15887:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789302725.204868:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789302725.205094:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789302725.205119:0:15886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789302725.205141:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69033f8200/0x20be524657f127ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127b2 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.205153:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69033f8200/0x20be524657f127ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127b2 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302725.205171:0:15886:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69369ec800 from 1 10000000:01000000:3.0:1789302725.205174:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789302725.205215:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.205223:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.205234:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302725.205256:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789302725.205340:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302725.205381:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302725.205494:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505243008 00000100:00100000:0.0:1789302725.205501:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505243008 00000100:00100000:0.0:1789302725.205549:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789302725.205559:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+17:15886:x1876219505243008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789302725.205572:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302725.205584:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f127c7 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.205605:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f127c7 expref: 18 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.205615:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f127c7 expref: 18 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.205624:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8e00, rc 0) 00000100:00100000:0.0:1789302725.205658:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243008:12345-0@lo:101:mount.lustre.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302725.205665:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789302725.205750:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789302725.205764:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.205781:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789302725.208477:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789302725.212102:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789302725.216791:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789302725.216870:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789302725.216946:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789302725.219132:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789302725.219255:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302725.219336:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302725.219380:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302725.222817:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505243136 00000100:00100000:1.0:1789302725.222842:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505243136 00000100:00100000:1.0:1789302725.222903:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789302725.222912:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302725.223235:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243136:12345-0@lo:501:mount.lustre.0 Request processed in 323us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.223244:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789302725.223833:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789302725.223887:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789302725.223943:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302725.223994:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302725.224096:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505243264 00000100:00100000:1.0:1789302725.224101:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505243264 00000100:00100000:1.0:1789302725.224137:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789302725.224144:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302725.224342:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243264:12345-0@lo:503:mount.lustre.0 Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.224349:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789302725.224490:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789302725.226112:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789302725.227061:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302725.227127:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302725.227178:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789302725.228490:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505243392 00000100:00100000:3.0:1789302725.228502:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505243392 00000100:00100000:3.0:1789302725.228602:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789302725.228612:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302725.228865:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243392:12345-0@lo:502:mount.lustre.0 Request processed in 255us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302725.228873:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789302725.243547:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789302725.243912:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789302725.243986:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789302725.244039:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789302725.244079:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789302725.244116:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789302725.244197:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789302725.244251:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789302725.244334:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789302725.244379:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789302725.244454:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302725.244497:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302725.244731:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505243520 00000100:00100000:1.0:1789302725.244739:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505243520 00000100:00100000:1.0:1789302725.244787:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789302725.244797:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302725.245007:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f648450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243520:12345-0@lo:502:mount.lustre.0 Request processed in 211us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.245016:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789302725.246307:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789302725.246453:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789302725.246468:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789302725.248843:0:15891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302725.248857:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.248859:0:15891:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789302725.248867:0:15891:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69369ec800 00000020:00000080:1.0:1789302725.248882:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302725.248890:0:15891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302725.248893:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.248894:0:15891:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789302725.248897:0:15891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302725.248899:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.248901:0:15891:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789302725.248904:0:15891:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a69369ec800 00000020:00000080:1.0:1789302725.248907:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789302725.248961:0:15891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789302725.250579:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.250585:0:15891:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789302725.250593:0:15891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789302725.250599:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789302725.250600:0:15891:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789302725.250605:0:15891:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a69369ec800 00000020:00000080:1.0:1789302725.250607:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789302725.254428:0:15891:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789302725.254442:0:15891:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789302725.254444:0:15891:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789302725.254449:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789302725.256584:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789302725.256623:0:15886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789302725.256652:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.256665:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789302725.256723:0:15886:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789302725.256727:0:15886:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a69369ec800 10000000:01000000:0.0:1789302725.256730:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a69369ec800 10000000:01000000:0.0:1789302725.256734:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789302725.256740:0:15886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a69369ec800 from 1 10000000:01000000:0.0:1789302725.256743:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789302725.256781:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f9200/0x20be524657f127d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.256790:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a68049f9200/0x20be524657f127d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302725.256801:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a68049f9200/0x20be524657f127d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302725.256826:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789302725.256895:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302725.256937:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302725.259803:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505243648 00000100:00100000:2.0:1789302725.259818:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505243648 00000100:00100000:1.0:1789302725.262469:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789302725.262482:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505243648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302725.262499:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302725.262519:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361ab800/0x20be524657f127dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f127d5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302725.262548:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361ab800/0x20be524657f127dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f127d5 expref: 19 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302725.262560:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361ab800/0x20be524657f127dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f127d5 expref: 19 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302725.262568:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361ab800, rc 0) 00000100:00100000:1.0:1789302725.262646:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f64b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505243648:12345-0@lo:101:mount.lustre.0 Request processed in 166us (5749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.262661:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789302725.262710:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789302725.262730:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a68049f9200/0x20be524657f127d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127dc expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302725.262740:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a68049f9200/0x20be524657f127d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f127dc expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789302725.269589:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789302725.269952:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789302725.275404:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789302725.275492:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789302725.275545:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789302725.275588:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789302725.275617:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789302725.275655:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789302725.275684:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789302725.275717:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789302725.275766:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789302725.275805:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789302725.275842:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789302725.275903:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789302725.275939:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789302725.275966:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789302725.276011:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789302725.276049:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789302725.276084:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789302725.276147:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789302725.279038:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789302725.279130:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789302725.279318:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789302725.279361:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789302725.279395:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789302725.279452:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789302725.279485:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789302725.279519:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789302725.279570:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789302725.279608:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789302725.279638:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789302725.279676:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789302725.279705:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789302725.279735:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789302725.279762:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789302725.279812:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789302725.279865:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789302725.279917:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789302725.279956:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789302725.280056:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789302725.280064:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789302725.280156:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302725.282337:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302725.282395:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69090536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302725.282484:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505243776 00000100:00100000:2.0:1789302725.282494:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505243776 00000100:00100000:2.0:1789302725.282547:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789302725.282558:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505243776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789302725.282840:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505243776:12345-0@lo:501:mount.lustre.0 Request processed in 283us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302725.282848:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789302725.282930:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789302725.282972:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789302725.283007:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302725.283305:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69090536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302725.293329:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505243904 00000100:00100000:2.0:1789302725.293345:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505243904 00000100:00100000:2.0:1789302725.293406:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789302725.293415:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505243904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789302725.293648:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505243904:12345-0@lo:503:mount.lustre.0 Request processed in 234us (10639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302725.293656:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789302725.296330:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505243904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789302725.296938:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789302725.297022:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806971180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505244032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302725.297101:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302725.297146:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69090536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302725.297186:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505244032 00000100:00100000:1.0:1789302725.297193:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505244032 00000100:00100000:1.0:1789302725.299340:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789302725.299352:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505244032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302725.299670:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505244032:12345-0@lo:502:mount.lustre.0 Request processed in 319us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.299679:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789302725.308718:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806971180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505244032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789302725.309074:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789302725.309134:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789302725.309177:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789302725.310050:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789302725.310105:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789302725.310152:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789302725.311319:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789302725.311390:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789302725.311450:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789302725.311487:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789302725.311522:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789302725.311568:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789302725.311617:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789302725.311670:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789302725.311720:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789302725.311757:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789302725.311791:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789302725.311838:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789302725.311875:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789302725.311910:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789302725.311956:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789302725.311992:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789302725.312024:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789302725.312080:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789302725.312121:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789302725.312156:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789302725.312779:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789302725.312827:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789302725.312865:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789302725.312933:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789302725.312972:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789302725.313008:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789302725.313043:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789302725.313091:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789302725.313125:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789302725.313188:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789302725.324649:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789302725.324708:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789302725.324819:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789302725.324861:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789302725.324912:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505244160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789302725.324989:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302725.325034:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909053000 going to sleep for 11 seconds 00000100:00100000:2.0:1789302725.325138:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505244160 00000100:00100000:2.0:1789302725.325146:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505244160 00000100:00100000:2.0:1789302725.325216:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789302725.325225:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505244160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789302725.325482:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f648850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505244160:12345-0@lo:502:mount.lustre.0 Request processed in 258us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302725.325490:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789302725.326366:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505244160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789302725.326470:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789302725.326482:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789302725.329054:0:15896:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789302725.329071:0:15896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a693bb8cd40) 00000020:00000080:3.0:1789302725.329091:0:15896:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789302725.329190:0:15896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a69369ec800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789302725.329194:0:15896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a69369ec800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789302725.329197:0:15896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a69369ec800 3 00010000:00080000:3.0:1789302725.329234:0:15896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a693c219000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.142@tcp at head 00010000:00010000:3.0:1789302725.330857:0:15896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789302725.331060:0:15896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789302725.331093:0:15896:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789302725.331107:0:15896:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x20be524657f127ea 00000100:00080000:3.0:1789302725.331117:0:15896:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789302725.331129:0:15896:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a693c219000 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:3.0:1789302725.331178:0:15896:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806192a00 x1876219505244288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789302725.331209:0:15896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789302725.331446:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789302725.331450:0:14031:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789302725.331453:0:14031:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789302725.331457:0:14031:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1789302725.331461:0:14031:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789302725.331466:0:14031:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69369f9800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:1.0:1789302725.331479:0:14031:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6806973480 x1876219505244544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789302725.331529:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302725.331543:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505244416:0@lo:400:kworker.0 00000100:00100000:1.0:1789302725.331606:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302725.331646:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505244672:0@lo:400:kworker.0 00000100:00100000:1.0:1789302725.331671:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302725.331689:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789302725.331694:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505244800:0@lo:400:kworker.0 00000100:00100000:1.0:1789302725.331718:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302725.331752:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505244416 00000100:00100000:1.0:1789302725.331759:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505244416 00000100:00100000:1.0:1789302725.331811:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302725.331820:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505244416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302725.331868:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806971180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505244416:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.331875:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302725.331896:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505244672 00000100:00100000:1.0:1789302725.331900:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505244672 00000100:00100000:1.0:1789302725.331923:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505244800 00000100:00100000:1.0:1789302725.331926:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505244800 00000100:00100000:1.0:1789302725.331943:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302725.331949:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505244672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302725.331984:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505244672:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.331991:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789302725.332002:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302725.332008:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505244800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302725.332045:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876219505244800:12345-0@lo:400:kworker.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.332052:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789302725.332092:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505244416:0@lo:400:kworker.0 00010000:00080000:1.0:1789302725.332122:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806970e00 x1876219505244800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302725.332132:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1876219505244800:0@lo:400:kworker.0 00010000:00080000:1.0:1789302725.332142:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806970a80 x1876219505244672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302725.332151:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505244672:0@lo:400:kworker.0 00000100:00100000:2.0:1789302725.336280:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876219505244288:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789302725.336375:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.336429:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505244544:0@lo:8:kworker.0 00000100:00100000:2.0:1789302725.336454:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.336499:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505244544 00000100:00100000:2.0:1789302725.336506:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505244544 00000100:00100000:2.0:1789302725.336542:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302725.336549:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1876219505244544:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789302725.336605:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1876219505244544:12345-0@lo:8:kworker.0 Request processed in 55us (150us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789302725.336612:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302725.336646:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789302725.336653:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789302725.336657:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789302725.336660:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505244544:0@lo:8:kworker.0 00000100:00080000:3.0:1789302725.338818:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302725.338828:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789302725.338976:0:15896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1789302725.339136:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505244288 00000100:00100000:1.0:1789302725.339146:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505244288 00000100:00100000:1.0:1789302725.339193:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789302725.339200:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1876219505244288:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789302725.339223:0:14485:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:1.0:1789302725.339270:0:14485:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x20be524657f127f1 00000004:00100000:1.0:1789302725.339304:0:14485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789302725.339338:0:14485:0:(import.c:65:import_set_state_nolock()) ffff9a6807009000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302725.339416:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876219505244288:12345-0@lo:38:llog_process_th.0 Request processed in 214us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302725.339424:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:1.0:1789302725.339445:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789302725.339471:0:15886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789302725.339486:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a68049f9200/0x20be524657f127d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127dc expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302725.339504:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a68049f9200/0x20be524657f127d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f127dc expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789302725.339554:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789302725.339557:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789302725.339558:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302725.339559:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302725.339560:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302725.339561:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302725.339563:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302725.339565:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302725.339566:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789302725.339569:0:15886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789302725.339572:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789302725.339573:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789302725.339574:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789302725.339575:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789302725.339576:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789302725.339577:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789302725.339578:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789302725.339579:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789302725.339580:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789302725.339599:0:15886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789302725.339616:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806970a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505244928:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789302725.339656:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302725.339687:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6909053f00 going to sleep for 11 seconds 00010000:00080000:1.0:1789302725.339727:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6806192a00 x1876219505244288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789302735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302725.339738:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789302725.339744:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789302725.339751:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789302725.339756:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789302725.339764:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a693c219000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789302725.339770:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1876219505244288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789302725.339799:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505244928 00000100:00100000:1.0:1789302725.339802:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505244928 00000100:00100000:1.0:1789302725.339830:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789302725.339836:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:15886:x1876219505244928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789302725.339864:0:14481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789302725.339877:0:14481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789302725.440279:0:14481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789302725.440361:0:14481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789302725.447689:0:14500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789302725.447700:0:14500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789302725.447725:0:14500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.447744:0:14500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f126c4 expref: 19 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.447753:0:14500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.447798:0:14500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f126c4 expref: 19 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.447832:0:14500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f126c4 expref: 19 pid: 14479 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302725.447847:0:14500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876219505245056:0@lo:104: 00000100:00100000:2.0:1789302725.447908:0:14500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302725.447971:0:14500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69367196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302725.448324:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505245056 00000100:00100000:3.0:1789302725.448332:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505245056 00000100:00100000:3.0:1789302725.448382:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302725.448392:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+3:14500:x1876219505245056:12345-0@lo:104: 00010000:00010000:3.0:1789302725.448404:0:14470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448472:0:14470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302725.448480:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+3:14500:x1876219505245056:12345-0@lo:104: Request processed in 90us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302725.448487:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789302725.448507:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302725.448513:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448520:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9e00 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302725.448525:0:14474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448546:0:14474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302725.448552:0:14474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302725.448558:0:14474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789302725.448587:0:14474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448593:0:14474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302725.448612:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448619:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69033f9e00/0x20be524657f126c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f126cb expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448633:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302725.448635:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302725.448636:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302725.448654:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57a3ba4d-eae9-4780-ad89-641003f4f604:3303:1876219505245184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302725.448682:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302725.448721:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505245184 00000100:00100000:3.0:1789302725.448725:0:14473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505245184 00010000:00010000:3.0:1789302725.448742:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f126c4 expref: 20 pid: 14479 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302725.448762:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302725.448769:0:14473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+20:3303:x1876219505245184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302725.448786:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302725.448792:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f126c4 expref: 20 pid: 14479 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448802:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f126c4 expref: 20 pid: 14479 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448818:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448826:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789302725.448838:0:14473:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003118076s 00010000:00010000:3.0:1789302725.448843:0:14473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448849:0:14473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448855:0:14473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448861:0:14473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448866:0:14473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302725.448870:0:14473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448876:0:14473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448893:0:14473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302725.448902:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302725.448929:0:14473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+20:3303:x1876219505245184:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302725.448935:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302725.448971:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57a3ba4d-eae9-4780-ad89-641003f4f604:3303:1876219505245184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789302725.449095:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69361ab400/0x20be524657f126cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f126c4 expref: 19 pid: 14479 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302725.449106:0:14500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14500:1876219505245056:0@lo:104: 00010000:00010000:2.0:1789302725.449119:0:14500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.449128:0:14500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.449134:0:14500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302725.449139:0:14500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69033f9a00/0x20be524657f127f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302725.456314:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+18:15886:x1876219505244928:12345-0@lo:253:mount.lustre.0 Request processed in 116469us (116648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302725.456329:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789302725.456450:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806970a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:57a3ba4d-eae9-4780-ad89-641003f4f604:15886:1876219505244928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789302725.456465:0:15886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789302725.456468:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789302725.456470:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789302725.456471:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789302725.456473:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789302725.456474:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789302725.456475:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789302725.456476:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789302725.456478:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789302725.456479:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789302725.456493:0:15886:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789302725.459040:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302725.459191:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789302725.459362:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302725.459484:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789302725.459600:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789302725.459778:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789302725.476933:0:15886:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789302725.583591:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789302725.633089:0:15886:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789302725.633101:0:15886:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789302725.633136:0:15886:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789302725.633236:0:15886:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.142@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789302725.633254:0:15886:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789302725.633317:0:15886:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00100000:0.0:1789302726.172825:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789302726.172841:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1789302726.608994:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302727.053794:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505245312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302727.053888:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302727.054036:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505245312 00000100:00100000:2.0:1789302727.054058:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505245312 00000100:00100000:2.0:1789302727.054156:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302727.054181:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505245312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302727.054243:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789302727.054342:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302727.064499:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505245312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10309us (10598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302727.064518:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789302727.064667:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789302727.064704:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505245312:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789302727.437408:0:14483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789302727.437417:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6805068800 from 8 10000000:01000000:3.0:1789302727.437425:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789302727.437477:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f127ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302727.437492:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f127ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302727.437506:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f127ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302727.437537:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806191500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505245440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789302727.437617:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302727.437669:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6902b590c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302727.439856:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505245440 00000100:00100000:1.0:1789302727.439873:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505245440 00000100:00100000:1.0:1789302727.439933:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789302727.439944:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+18:14483:x1876219505245440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302727.439965:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302727.439990:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361aa000/0x20be524657f12806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f127ff expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302727.440023:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361aa000/0x20be524657f12806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f127ff expref: 19 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302727.440035:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361aa000/0x20be524657f12806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f127ff expref: 19 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302727.440047:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aa000, rc 0) 00000100:00100000:1.0:1789302727.440136:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+19:14483:x1876219505245440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302727.440155:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789302727.440249:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806191500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505245440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302727.440283:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f127ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12806 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302727.440903:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f127ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f12806 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302727.440986:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6806970e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505245568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789302727.441036:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302727.441072:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693671cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789302727.441091:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505245568 00000100:00100000:1.0:1789302727.441095:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505245568 00000100:00100000:1.0:1789302727.441123:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789302727.441130:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:14483:x1876219505245568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789302727.441157:0:14481:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789302727.441176:0:14481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789302727.441178:0:14481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789302727.441252:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:14483:x1876219505245568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302727.441260:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789302727.443245:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6806970e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505245568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789302727.443362:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789302727.443373:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f127ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12806 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302727.443385:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a692aba6200/0x20be524657f127ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12806 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302727.629564:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789302728.207263:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789302728.657584:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302729.688089:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789302730.644577:0:14031:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789302730.644584:0:14031:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789302730.644589:0:14031:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789302730.644611:0:14031:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a69369f9800 using connection 192.168.203.142@tcp/0@lo 00000100:00100000:0.0:1789302730.644640:0:14031:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68053db100 x1876219505245952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789302730.644727:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505245696:0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.644819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.644878:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505246336:0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.644922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.644956:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302730.644962:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505245824:0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.644987:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.645028:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505245952:0@lo:8:kworker.0 00000100:00100000:0.0:1789302730.645052:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.645081:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505246080:0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.645107:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.645137:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302730.645143:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505246208:0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.645165:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.645203:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505245696 00000100:00100000:0.0:1789302730.645213:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505245696 00000100:00100000:0.0:1789302730.645268:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302730.645279:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3305:x1876219505245696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.645365:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3305:x1876219505245696:12345-0@lo:400:kworker.0 Request processed in 87us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302730.645373:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789302730.645412:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505246336 00000100:00100000:0.0:1789302730.645416:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505246336 00000100:00100000:0.0:1789302730.645448:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505246080 00000100:00100000:0.0:1789302730.645451:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505246080 00000100:00100000:0.0:1789302730.645462:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505246208 00000100:00100000:0.0:1789302730.645465:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505246208 00000100:00100000:0.0:1789302730.645478:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302730.645484:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505246336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.645517:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505246336:12345-0@lo:400:kworker.0 Request processed in 33us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302730.645524:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302730.645536:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302730.645541:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505246080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.645572:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876219505246080:12345-0@lo:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302730.645578:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789302730.645588:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302730.645594:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505246208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.645618:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876219505246208:12345-0@lo:400:kworker.0 Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302730.645625:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789302730.645644:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505245824 00000100:00100000:0.0:1789302730.645647:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505245824 00000100:00100000:0.0:1789302730.645677:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505245952 00000100:00100000:0.0:1789302730.645686:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505245952 00000100:00100000:0.0:1789302730.645709:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302730.645716:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505245824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302730.645749:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505245824:12345-0@lo:400:kworker.0 Request processed in 35us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302730.645755:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789302730.645766:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302730.645770:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3302:x1876219505245952:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789302730.645802:0:15728:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:0.0:1789302730.645844:0:15728:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x20be524657f1280d 00002000:00100000:0.0:1789302730.645861:0:15728:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a6805293800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789302730.645866:0:15728:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789302730.645870:0:15728:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789302730.646018:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505245824:0@lo:400:kworker.0 00000100:00100000:1.0:1789302730.646029:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505245696:0@lo:400:kworker.0 00010000:00080000:1.0:1789302730.646040:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68053d9180 x1876219505246336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302730.646049:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505246336:0@lo:400:kworker.0 00010000:00080000:1.0:1789302730.646113:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68053d9880 x1876219505246208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302730.646138:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1876219505246208:0@lo:400:kworker.0 00010000:00080000:1.0:1789302730.646150:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68053d8700 x1876219505246080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789302730.646158:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876219505246080:0@lo:400:kworker.0 00000100:00080000:1.0:1789302730.646176:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789302730.646182:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:0.0:1789302730.646340:0:15728:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789302730.646371:0:15728:0:(import.c:65:import_set_state_nolock()) ffff9a6805296000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302730.646417:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876219505245952:12345-0@lo:8:kworker.0 Request processed in 646us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302730.646425:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789302730.646453:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68053db100 x1876219505245952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789302755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789302730.646465:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789302730.646474:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789302730.646481:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789302730.646483:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9a69369f9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789302730.646500:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789302730.646506:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1876219505245952:0@lo:8:kworker.0 00000004:00080000:0.0:1789302730.646572:0:14509:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789302730.646594:0:14509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14509:1876219505246592:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789302730.646624:0:14509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.646643:0:14509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604f240 going to sleep for 11 seconds 00000004:00080000:0.0:1789302730.646661:0:14508:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789302730.647078:0:14508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441832791241ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789302730.647107:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505246464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302730.647152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.647198:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505246592 00000100:00100000:0.0:1789302730.647205:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505246592 00000100:00100000:0.0:1789302730.647247:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302730.647255:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14509:x1876219505246592:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789302730.653563:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505246464 00000100:00100000:2.0:1789302730.653586:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505246464 00000100:00100000:2.0:1789302730.653673:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789302730.653687:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876219505246464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302730.653742:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302730.653860:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876219505246464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (6707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302730.653868:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789302730.655711:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789302730.656357:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68053db100 x1876219505246464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789302746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302730.656394:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505246464:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1789302730.674367:0:15169:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789302730.674389:0:15169:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789302730.674396:0:15169:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1789302730.687231:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.687246:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687267:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.687273:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.687280:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687352:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687366:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687376:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687402:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302730.687419:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.687426:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687435:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.687440:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687450:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687470:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687478:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f243a725/0x20be524657f12814 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.687507:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.687510:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.687513:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.688225:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.688234:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688246:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.688250:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.688255:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688267:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688275:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688282:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688356:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302730.688365:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.688371:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688391:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.688395:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688405:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688418:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688426:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb990f82/0x20be524657f1281b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688442:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.688444:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.688447:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.688953:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.688961:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688971:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.688974:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.688979:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.688991:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.689007:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.689016:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.689034:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302730.689045:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.689050:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.689057:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.689062:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.689072:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.689086:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.689094:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c563d761/0x20be524657f12822 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.689111:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.689119:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.691779:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.692578:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.692593:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.692616:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.692621:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.692630:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.692649:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.692661:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.692669:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.692697:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302730.693109:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.693115:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693136:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.693139:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.693143:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693161:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693170:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.693177:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.693179:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.693191:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693199:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302730.693205:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.693212:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302730.693214:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.693229:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.693266:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.693403:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f12829 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.693430:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.693433:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.693435:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.693778:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.693784:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693793:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.693796:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.693800:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693810:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693819:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693841:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.693863:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302730.694258:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.694264:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694274:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.694277:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.694281:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694316:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694325:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694333:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694343:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789302730.694718:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.694724:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694739:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.694742:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.694747:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694757:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694767:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694775:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.694785:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789302730.698748:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789302730.698766:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698785:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8400 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302730.698791:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698805:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698833:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698841:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f12837 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698884:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789302730.698890:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698897:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302730.698900:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698908:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698920:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698928:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f1283e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698940:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302730.698945:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302730.698946:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789302730.698957:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.698962:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.698963:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.698990:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.699000:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302730.699001:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.699010:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.699014:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.699032:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.699033:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f12845 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.699057:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.699060:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.699063:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.699073:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.699082:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.699116:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302730.699365:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302730.699371:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.699380:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302730.699385:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.699393:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.699406:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.699425:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f1284c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.699442:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.699444:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.699446:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.701150:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.701156:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.701159:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.701167:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701183:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.701188:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701201:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701223:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701232:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f12830 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701258:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.701261:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.701270:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.701607:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.701667:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.701674:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701688:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.701693:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.701702:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701718:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701729:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701737:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.701761:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302730.702148:0:16086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302730.702156:0:16086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702166:0:16086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302730.702171:0:16086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702180:0:16086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702195:0:16086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702203:0:16086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f12853 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302730.702212:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.702220:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702234:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.702237:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302730.702240:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.702242:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702244:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.702248:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.702269:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702278:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702304:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702322:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302730.702358:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302730.702365:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702375:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302730.702380:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702390:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702402:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702409:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8e46498/0x20be524657f1285a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.702428:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.702431:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.702433:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.702760:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.702767:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702777:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.702780:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.702784:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702794:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702804:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702822:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.702843:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789302730.703097:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789302730.703106:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.703135:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044600 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302730.703139:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.703148:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.703160:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.703167:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dab5dc04/0x20be524657f12861 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302730.703183:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.703185:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302730.703187:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.707684:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.707703:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.707724:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.707730:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.707739:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.707756:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.707767:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.707775:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.707802:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302730.708379:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.708388:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.708405:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.708408:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.708412:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.708423:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.708431:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.708439:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.708463:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789302730.708970:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.708977:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.708985:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.708988:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.708992:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709003:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709028:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709032:0:16086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302730.709040:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709045:0:16086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709059:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789302730.709070:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302730.709074:0:16086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.709077:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709082:0:16086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709089:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044400 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.709096:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709101:0:16086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709109:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709143:0:16086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709143:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709165:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964efbb8/0x20be524657f1286f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709166:0:16086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062c38e99/0x20be524657f12868 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709209:0:16086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.709209:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.709213:0:16086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709219:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.709223:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.709224:0:16086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302730.709229:0:16086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709237:0:16086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709249:0:16086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709263:0:16086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0aff05f/0x20be524657f12876 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.709310:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.709313:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.709316:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.709666:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.709672:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709681:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.709684:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.709688:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709699:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709708:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709714:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709729:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302730.709737:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.709741:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709747:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.709750:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709769:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709779:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709786:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d73b90bd/0x20be524657f1287d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.709799:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.709801:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.709802:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302730.713088:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.714966:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.714986:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.715011:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.715017:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.715026:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.715043:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.715056:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.715078:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.715263:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302730.718088:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.718104:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.718136:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.718142:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.718151:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.718169:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.718182:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.718191:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720660:0:16086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302730.720678:0:16086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720695:0:16086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045200 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302730.720701:0:16086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720714:0:16086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720741:0:16086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720749:0:16086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065d66c06/0x20be524657f12884 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720778:0:16086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302730.720782:0:16086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720803:0:16086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302730.720806:0:16086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720815:0:16086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720827:0:16086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.720835:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.720837:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.720839:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.722210:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789302730.722224:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f3b5701/0x20be524657f1288b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.722281:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.723106:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.723117:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723145:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.723152:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.723159:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723175:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723187:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723196:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723222:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302730.723653:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.723659:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723668:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.723672:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.723683:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723692:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723700:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723708:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.723727:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789302730.723849:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302730.723859:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723867:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302730.723872:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723882:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723901:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723917:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6aaad11/0x20be524657f12892 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723942:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302730.723946:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723953:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302730.723957:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723965:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723977:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.723985:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e33573b1/0x20be524657f12899 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302730.724002:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.724004:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.724007:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302730.724394:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.725951:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.725965:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.725984:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.725990:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.725997:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726016:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726028:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726050:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726072:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302730.726087:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.726093:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726103:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.726108:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726119:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726150:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726159:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000744e61b6/0x20be524657f128a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726181:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.726183:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.726185:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.726785:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.726800:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726810:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.726813:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.726817:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726828:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726836:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726844:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.726867:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302730.727556:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.727564:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.727576:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.727579:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.727583:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.727594:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.727609:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.727617:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.727636:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789302730.727758:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789302730.727768:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302730.727780:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302730.727785:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302730.727797:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302730.727819:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302730.727835:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b97be2c4/0x20be524657f128a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302730.727862:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302730.727867:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302730.727874:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302730.727878:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302730.728075:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.728080:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728090:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.728093:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.728097:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728107:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728115:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728133:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728160:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302730.728171:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.728176:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728184:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9a00 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.728188:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728196:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728207:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728215:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bbf75ae/0x20be524657f128b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728234:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.728236:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.728239:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.728247:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302730.728252:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302730.728268:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302730.728367:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f8290eb/0x20be524657f128ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789302730.728702:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.728708:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728728:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.728732:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.728737:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728748:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728757:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728766:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728781:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789302730.728790:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.728794:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728802:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9800 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.728806:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728815:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728837:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728846:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ddff/0x20be524657f128bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.728860:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.728862:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.728864:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789302730.729329:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.729336:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729345:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.729348:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.729352:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729362:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729370:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729378:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729404:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789302730.729841:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789302730.729847:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729857:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789302730.729861:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789302730.729866:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729877:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729887:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729896:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729912:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789302730.729923:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789302730.729928:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729936:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8400 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.729947:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729957:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729973:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.729982:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d28c922/0x20be524657f128c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.730000:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789302730.730004:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.730011:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:0.0:1789302730.730015:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.730023:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.730033:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.730041:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d309ef01/0x20be524657f128ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302730.730063:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.730064:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.730066:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789302730.730073:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789302730.730279:0:15169:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1789302730.730420:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14509:x1876219505246592:12345-0@lo:5:osp-pre-1-0.0 Request processed in 83159us (83788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302730.730431:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302730.730499:0:14509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14509:1876219505246592:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789302730.730520:0:14509:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789302730.730584:0:14509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14509:1876219505246720:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789302730.730629:0:14509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302730.730683:0:14509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789302730.730708:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505246720 00000100:00100000:0.0:1789302730.730717:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505246720 00000100:00100000:0.0:1789302730.730768:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789302730.730779:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14509:x1876219505246720:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789302730.730833:0:15168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1789302730.732269:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302730.732462:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302730.732466:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302730.736345:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14509:x1876219505246720:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5554us (5701us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789302730.736365:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302730.736383:0:14509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053dbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14509:1876219505246720:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789302730.736409:0:14509:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1789302730.746105:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789302731.729987:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302732.175301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505246848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789302732.175370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302732.180196:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505246848 00000100:00100000:2.0:1789302732.180212:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505246848 00000100:00100000:2.0:1789302732.180311:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302732.180323:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505246848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789302732.180362:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302732.180448:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505246848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (5077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302732.180455:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789302732.180509:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505246848:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789302732.180594:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789302732.768376:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789302733.632072:0:16244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg342-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789302733.793442:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302734.799320:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302735.757719:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505246976:0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.757817:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302735.757865:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505247488:0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.757891:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302735.757917:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302735.757923:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505247360:0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.757943:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302735.757972:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505247104:0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.757998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302735.758014:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505247616:0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.758032:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302735.758049:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789302735.758054:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505247232:0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.759228:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302735.759310:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505246976 00000100:00100000:0.0:1789302735.759319:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505246976 00000100:00100000:3.0:1789302735.759530:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505247104 00000100:00100000:3.0:1789302735.759536:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505247104 00000100:00100000:3.0:1789302735.759580:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505247232 00000100:00100000:3.0:1789302735.759583:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505247232 00000100:00100000:3.0:1789302735.759604:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302735.759613:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505247104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302735.759669:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505247104:12345-0@lo:400:kworker.0 Request processed in 57us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302735.759676:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789302735.759692:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789302735.759698:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505247232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302735.759722:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505247232:12345-0@lo:400:kworker.0 Request processed in 25us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302735.759741:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789302735.759768:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789302735.759772:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302735.760329:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505247232:0@lo:400:kworker.0 00000100:00100000:3.0:1789302735.760344:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505247104:0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.762850:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505247488 00000100:00100000:0.0:1789302735.762860:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505247488 00000100:00100000:0.0:1789302735.762922:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505247360 00000100:00100000:0.0:1789302735.762926:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505247360 00000100:00100000:0.0:1789302735.762939:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505247616 00000100:00100000:0.0:1789302735.762941:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505247616 00000100:00100000:0.0:1789302735.762958:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302735.762967:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505247488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.763050:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505247488:12345-0@lo:400:kworker.0 Request processed in 84us (5157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302735.763056:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789302735.763073:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302735.763103:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505247360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.763133:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505247360:12345-0@lo:400:kworker.0 Request processed in 32us (5189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302735.763139:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789302735.763151:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302735.763157:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505247616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.763183:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505247616:12345-0@lo:400:kworker.0 Request processed in 26us (5150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302735.763189:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302735.763217:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789302735.763225:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3304:x1876219505246976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.763256:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3304:x1876219505246976:12345-0@lo:400:kworker.0 Request processed in 32us (5440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302735.763263:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789302735.764064:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c50c380 x1876219505247616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789302735.764078:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505247616:0@lo:400:kworker.0 00000100:00100000:3.0:1789302735.764107:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302735.764116:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505247744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302735.764161:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302735.765709:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505247744 00000100:00100000:2.0:1789302735.765720:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505247744 00000100:00100000:2.0:1789302735.765778:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789302735.765788:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505247744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789302735.765820:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789302735.765895:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876219505247744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302735.765903:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789302735.765930:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302735.765967:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505247744:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789302735.766031:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c50e300 x1876219505247360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302735.766045:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505247360:0@lo:400:kworker.0 00000100:00100000:0.0:1789302735.766056:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505246976:0@lo:400:kworker.0 00010000:00080000:0.0:1789302735.766080:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a693c50f100 x1876219505247488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789302751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789302735.766097:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505247488:0@lo:400:kworker.0 00010000:00010000:0.0:1789302735.827230:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789302735.926216:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789302735.926264:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789302736.201394:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302736.203524:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484282496 00000100:00100000:2.0:1789302736.203538:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484282496 00000100:00100000:2.0:1789302736.203603:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:2.0:1789302736.203611:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1876219484282496:12345-192.168.203.42@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789302736.203640:0:14481:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0b16efc0-55ce-4cfe-ad9d-9da090882911@192.168.203.42@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1789302736.203669:0:14481:0:(genops.c:1384:class_connect()) connect: client 0b16efc0-55ce-4cfe-ad9d-9da090882911, cookie 0x20be524657f128d1 00000100:00080000:2.0:1789302736.203815:0:14481:0:(import.c:65:import_set_state_nolock()) ffff9a69046f4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789302736.203908:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+5:2350:x1876219484282496:12345-192.168.203.42@tcp:250:mount.lustre.0 Request processed in 296us (2523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302736.203927:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 76 00000100:00100000:3.0:1789302736.218749:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.219094:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484282624 00000100:00100000:0.0:1789302736.219105:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484282624 00000100:00100000:0.0:1789302736.219162:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:0.0:1789302736.219173:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+5:13770:x1876219484282624:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789302736.219189:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302736.219207:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f8400/0x20be524657f128d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3a11 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.219241:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f8400/0x20be524657f128d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a11 expref: 6 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.219252:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f8400/0x20be524657f128d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a11 expref: 6 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.219260:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8400, rc 0) 00000100:00100000:0.0:1789302736.219356:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+6:13770:x1876219484282624:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 185us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.219363:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 77 00000100:00100000:1.0:1789302736.236227:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.236712:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484282752 00000100:00100000:0.0:1789302736.236722:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484282752 00000100:00100000:0.0:1789302736.236787:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:0.0:1789302736.236797:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+6:13770:x1876219484282752:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789302736.244563:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+6:13770:x1876219484282752:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 7756us (8334us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789302736.244579:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 78 00000100:00100000:1.0:1789302736.249434:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302736.249586:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484282880 00000100:00100000:2.0:1789302736.249596:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484282880 00000100:00100000:2.0:1789302736.249656:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:2.0:1789302736.249665:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+6:13770:x1876219484282880:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789302736.249681:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302736.249697:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69033f8800/0x20be524657f128df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3a18 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302736.249725:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f8800/0x20be524657f128df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a18 expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302736.249737:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69033f8800/0x20be524657f128df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a18 expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302736.249745:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8800, rc 0) 00000100:00100000:2.0:1789302736.249805:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+7:13770:x1876219484282880:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 141us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302736.249812:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 79 00000100:00100000:3.0:1789302736.252545:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.254398:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484283008 00000100:00100000:0.0:1789302736.254413:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484283008 00000100:00100000:0.0:1789302736.254496:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:0.0:1789302736.254507:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+7:13770:x1876219484283008:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789302736.254801:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+8:13770:x1876219484283008:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 296us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.254809:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 80 00000100:00100000:3.0:1789302736.257002:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.257115:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484283136 00000100:00100000:0.0:1789302736.257127:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484283136 00000100:00100000:0.0:1789302736.257191:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:0.0:1789302736.257202:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+8:13770:x1876219484283136:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789302736.257591:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+8:13770:x1876219484283136:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 390us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.257599:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 81 00000100:00100000:1.0:1789302736.262491:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302736.262604:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484283264 00000100:00100000:2.0:1789302736.262614:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484283264 00000100:00100000:2.0:1789302736.262663:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:2.0:1789302736.262673:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+8:13788:x1876219484283264:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302736.263019:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+8:13788:x1876219484283264:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 347us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302736.263038:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 82 00000100:00100000:3.0:1789302736.279774:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.280039:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484283392 00000100:00100000:0.0:1789302736.280053:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484283392 00000100:00100000:0.0:1789302736.280324:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:0.0:1789302736.280337:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+8:13788:x1876219484283392:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302736.280653:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+8:13788:x1876219484283392:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 319us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.280661:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 83 00000100:00100000:3.0:1789302736.294587:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.303824:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484283520 00000100:00100000:0.0:1789302736.303853:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484283520 00000100:00100000:0.0:1789302736.303951:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:0.0:1789302736.303964:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+8:13770:x1876219484283520:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789302736.303987:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302736.304011:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f9800/0x20be524657f128e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3a42 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.304141:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f9800/0x20be524657f128e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a42 expref: 9 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.304157:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f9800/0x20be524657f128e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a42 expref: 9 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.304168:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9800, rc 0) 00000100:00100000:0.0:1789302736.304255:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+9:13770:x1876219484283520:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 294us (9681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.304263:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 84 00000100:00100000:1.0:1789302736.312454:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.313503:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484283648 00000100:00100000:0.0:1789302736.313519:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484283648 00000100:00100000:0.0:1789302736.313588:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:0.0:1789302736.313599:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+9:13770:x1876219484283648:12345-192.168.203.42@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789302736.313631:0:14479:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789302736.313660:0:14479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789302736.313664:0:14479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789302736.313667:0:14479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789302736.313670:0:14479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789302736.320470:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+9:13770:x1876219484283648:12345-192.168.203.42@tcp:256:mount.lustre.0 Request processed in 6854us (8011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.320491:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 85 00000100:00100000:1.0:1789302736.323692:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.327838:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484283776 00000100:00100000:0.0:1789302736.327861:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484283776 00000100:00100000:0.0:1789302736.328033:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:0.0:1789302736.328047:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+9:13770:x1876219484283776:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789302736.328099:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302736.328125:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3a49 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.328164:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 10 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.328178:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 10 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.328188:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9a00, rc 0) 00000100:00100000:0.0:1789302736.328281:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13770:x1876219484283776:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 236us (4602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302736.330202:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302736.330571:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484283904 00000100:00100000:2.0:1789302736.330583:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484283904 00000100:00100000:2.0:1789302736.330647:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 87 00000100:00100000:2.0:1789302736.330656:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13770:x1876219484283904:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789302736.330708:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 86 00000100:00100000:2.0:1789302736.330958:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13770:x1876219484283904:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 302us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302736.330965:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 87 00000100:00100000:3.0:1789302736.333588:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.333756:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484284032 00000100:00100000:0.0:1789302736.333767:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484284032 00000100:00100000:0.0:1789302736.333826:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 88 00000100:00100000:0.0:1789302736.333837:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13770:x1876219484284032:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789302736.335961:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13770:x1876219484284032:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 2113us (2370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.335977:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 88 00000100:00100000:1.0:1789302736.341658:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302736.341759:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484284160 00000100:00100000:3.0:1789302736.341772:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484284160 00000100:00100000:3.0:1789302736.341878:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:3.0:1789302736.341889:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13793:x1876219484284160:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789302736.345056:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13793:x1876219484284160:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 3152us (3394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302736.345074:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 89 00000100:00100000:1.0:1789302736.356799:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.356940:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484284288 00000100:00100000:0.0:1789302736.356953:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484284288 00000100:00100000:0.0:1789302736.357028:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:0.0:1789302736.357039:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13793:x1876219484284288:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302736.357717:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13793:x1876219484284288:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 676us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.357734:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 90 00000100:00100000:1.0:1789302736.370663:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.371275:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484284416 00000100:00100000:0.0:1789302736.371333:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484284416 00000100:00100000:0.0:1789302736.371396:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:0.0:1789302736.371407:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1876219484284416:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789302736.371443:0:14484:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ec38e548-5fa9-4016-a7ed-50e11bf82d59@192.168.203.42@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1789302736.371504:0:14484:0:(genops.c:1384:class_connect()) connect: client ec38e548-5fa9-4016-a7ed-50e11bf82d59, cookie 0x20be524657f128f4 00000004:00100000:0.0:1789302736.371544:0:14484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789302736.371552:0:14484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789302736.401667:0:14484:0:(import.c:65:import_set_state_nolock()) ffff9a680700c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302736.401757:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2350:x1876219484284416:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 30349us (31106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302736.401769:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789302736.411208:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.411316:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484284672 00000100:00100000:0.0:1789302736.411328:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484284672 00000100:00100000:0.0:1789302736.411418:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:0.0:1789302736.411432:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13770:x1876219484284672:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789302736.411492:0:14485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789302736.411617:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13770:x1876219484284672:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 188us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.411625:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:3.0:1789302736.413175:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00080000:2.0:1789302736.413313:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302736.413318:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484284544 00000100:00100000:0.0:1789302736.413329:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484284544 00000100:00100000:1.0:1789302736.413394:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:1.0:1789302736.413408:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:0:x1876219484284544:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789302736.413440:0:14485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789302736.413501:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:0:x1876219484284544:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 97us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302736.413514:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:3.0:1789302736.414636:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302736.414824:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484284800 00000100:00100000:1.0:1789302736.414833:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484284800 00000100:00100000:1.0:1789302736.414981:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789302736.414991:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13770:x1876219484284800:12345-192.168.203.42@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789302736.415224:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13770:x1876219484284800:12345-192.168.203.42@tcp:40:mount.lustre.0 Request processed in 234us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302736.415232:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:3.0:1789302736.419588:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302736.419685:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302736.419729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302736.419834:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484284928 00000100:00100000:1.0:1789302736.419846:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484284928 00000100:00100000:1.0:1789302736.419899:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484285056 00000100:00100000:1.0:1789302736.419902:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484285056 00000100:00100000:1.0:1789302736.419925:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:1.0:1789302736.419935:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876219484284928:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789302736.419974:0:15169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ec38e548-5fa9-4016-a7ed-50e11bf82d59@192.168.203.42@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1789302736.420024:0:15169:0:(genops.c:1384:class_connect()) connect: client ec38e548-5fa9-4016-a7ed-50e11bf82d59, cookie 0x20be524657f128fb 00002000:00100000:1.0:1789302736.420036:0:15169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec38e548-5fa9-4016-a7ed-50e11bf82d59/ffff9a680700e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789302736.420065:0:15169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789302736.420491:0:15169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789302736.420527:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a680700e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302736.420604:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2350:x1876219484284928:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 669us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302736.420613:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:1.0:1789302736.420635:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:1.0:1789302736.420640:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876219484285056:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789302736.420657:0:15169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ec38e548-5fa9-4016-a7ed-50e11bf82d59@192.168.203.42@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1789302736.420676:0:15169:0:(genops.c:1384:class_connect()) connect: client ec38e548-5fa9-4016-a7ed-50e11bf82d59, cookie 0x20be524657f12902 00002000:00100000:1.0:1789302736.420682:0:15169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec38e548-5fa9-4016-a7ed-50e11bf82d59/ffff9a680700b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789302736.420689:0:15169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789302736.420903:0:15169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789302736.420917:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a680700a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789302736.420939:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2350:x1876219484285056:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 298us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302736.420966:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:2.0:1789302736.424229:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484285184 00000100:00100000:2.0:1789302736.424250:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484285184 00000100:00100000:2.0:1789302736.424347:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:2.0:1789302736.424360:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13770:x1876219484285184:12345-192.168.203.42@tcp:33:mount.lustre.0 00000004:00080000:0.0:1789302736.428032:0:14487:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3584us 00000004:00200000:0.0:1789302736.455830:0:14487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789302736.456090:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13770:x1876219484285184:12345-192.168.203.42@tcp:33:mount.lustre.0 Request processed in 31717us (36501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.456110:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:3.0:1789302736.715533:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302736.715653:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484285312 00000100:00100000:0.0:1789302736.715685:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484285312 00000100:00100000:0.0:1789302736.715770:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:0.0:1789302736.715784:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13814:x1876219484285312:12345-192.168.203.42@tcp:101:mkdir.0 00010000:00010000:0.0:1789302736.715823:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302736.715859:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f12909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3a73 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.716025:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12910 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.716043:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.716062:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302736.716117:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789302736.716130:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302736.716197:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.716229:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8000/0x20be524657f12909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a73 expref: 8 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.716253:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a73 expref: 7 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302736.716264:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a690a0ce300) 00010000:00010000:0.0:1789302736.716268:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302736.716273:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8c00, rc 0) 00000100:00100000:0.0:1789302736.716448:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:13814:x1876219484285312:12345-192.168.203.42@tcp:101:mkdir.0 Request processed in 666us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302736.716456:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00010000:00010000:2.0:1789302736.845576:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302737.295021:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505247872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302737.295131:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302737.299119:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505247872 00000100:00100000:1.0:1789302737.299143:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505247872 00000100:00100000:1.0:1789302737.299334:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789302737.299347:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505247872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302737.299383:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302737.299505:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505247872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (4374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302737.299512:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789302737.301376:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505247872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302737.303806:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789302737.870108:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789302738.447507:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789302738.894482:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302738.897130:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302738.897596:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484285440 00000100:00100000:0.0:1789302738.897608:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484285440 00000100:00100000:0.0:1789302738.897705:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:0.0:1789302738.897718:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:13867:x1876219484285440:12345-192.168.203.42@tcp:41:lfs.0 00000004:00000024:0.0:1789302738.897778:0:14486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789302738.897889:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:13867:x1876219484285440:12345-192.168.203.42@tcp:41:lfs.0 Request processed in 173us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302738.897896:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00080000:2.0:1789302738.898161:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789302738.905491:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302738.905680:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484285568 00000100:00100000:1.0:1789302738.905694:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484285568 00000100:00100000:1.0:1789302738.905799:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:1.0:1789302738.905811:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13867:x1876219484285568:12345-192.168.203.42@tcp:13:lfs.0 00002000:00000024:1.0:1789302738.905861:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302738.905992:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13867:x1876219484285568:12345-192.168.203.42@tcp:13:lfs.0 Request processed in 183us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302738.906001:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00080000:2.0:1789302738.906608:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789302738.910279:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302738.911331:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484285696 00000100:00100000:1.0:1789302738.911348:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484285696 00000100:00100000:1.0:1789302738.911551:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789302738.911573:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13867:x1876219484285696:12345-192.168.203.42@tcp:13:lfs.0 00002000:00000024:1.0:1789302738.911623:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302738.911753:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:13867:x1876219484285696:12345-192.168.203.42@tcp:13:lfs.0 Request processed in 185us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302738.911781:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00080000:2.0:1789302738.917948:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302739.127508:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.127611:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484285824 00000100:00100000:3.0:1789302739.127624:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484285824 00000100:00100000:3.0:1789302739.127695:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00100000:3.0:1789302739.127708:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+10:13900:x1876219484285824:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789302739.127857:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302739.127885:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba6000/0x20be524657f12917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3a7a expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.127925:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba6000/0x20be524657f12917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a7a expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.128181:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba6000/0x20be524657f12917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a7a expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.128194:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6000, rc 0) 00000100:00100000:3.0:1789302739.128379:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13900:x1876219484285824:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 672us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.128845:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 91 00000100:00100000:0.0:1789302739.141954:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302739.142152:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484285952 00000100:00100000:2.0:1789302739.142168:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484285952 00000100:00100000:2.0:1789302739.142253:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 92 00000100:00100000:2.0:1789302739.142264:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13900:x1876219484285952:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789302739.143655:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13900:x1876219484285952:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 1382us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302739.143679:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 92 00000100:00100000:1.0:1789302739.147528:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.147674:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484286080 00000100:00100000:3.0:1789302739.147687:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484286080 00000100:00100000:3.0:1789302739.147772:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 93 00000100:00100000:3.0:1789302739.147785:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13900:x1876219484286080:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789302739.148096:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13900:x1876219484286080:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 312us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.148112:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 93 00000100:00100000:0.0:1789302739.152570:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302739.154620:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484286208 00000100:00100000:2.0:1789302739.154640:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484286208 00000100:00100000:2.0:1789302739.154729:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 94 00000100:00100000:2.0:1789302739.154752:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13905:x1876219484286208:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302739.155141:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13905:x1876219484286208:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 401us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302739.155150:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 94 00000100:00100000:1.0:1789302739.189097:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302739.189255:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484286336 00000100:00100000:0.0:1789302739.189271:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484286336 00000100:00100000:0.0:1789302739.189376:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:0.0:1789302739.189397:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13905:x1876219484286336:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302739.190010:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13905:x1876219484286336:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 613us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302739.190019:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 95 00000100:00100000:1.0:1789302739.215368:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.215476:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484286464 00000100:00100000:3.0:1789302739.215489:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484286464 00000100:00100000:3.0:1789302739.215563:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00100000:3.0:1789302739.215576:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13900:x1876219484286464:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789302739.215601:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302739.215636:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a692aba6400/0x20be524657f1291e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3aa4 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.215675:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a692aba6400/0x20be524657f1291e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aa4 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.215688:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a692aba6400/0x20be524657f1291e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aa4 expref: 12 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.215728:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6400, rc 0) 00000100:00100000:3.0:1789302739.215803:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13900:x1876219484286464:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 230us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.215812:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 96 00000100:00100000:1.0:1789302739.225130:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302739.225329:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484286592 00000100:00100000:0.0:1789302739.225344:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484286592 00000100:00100000:0.0:1789302739.225417:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:0.0:1789302739.225448:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13900:x1876219484286592:12345-192.168.203.42@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789302739.225484:0:14479:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789302739.225508:0:14479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789302739.225512:0:14479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789302739.225516:0:14479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789302739.225519:0:14479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789302739.229182:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13900:x1876219484286592:12345-192.168.203.42@tcp:256:mount.lustre.0 Request processed in 3715us (4050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302739.229206:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 97 00000100:00100000:1.0:1789302739.234341:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302739.234457:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484286720 00000100:00100000:2.0:1789302739.234473:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484286720 00000100:00100000:2.0:1789302739.234557:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 98 00000100:00100000:2.0:1789302739.234571:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13900:x1876219484286720:12345-192.168.203.42@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789302739.234594:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302739.234619:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3aab expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302739.234660:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 13 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302739.234674:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 13 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302739.234686:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8a00, rc 0) 00000100:00100000:2.0:1789302739.234763:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13900:x1876219484286720:12345-192.168.203.42@tcp:101:mount.lustre.0 Request processed in 195us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302739.234770:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 98 00000100:00100000:1.0:1789302739.240460:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302739.240723:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484286848 00000100:00100000:0.0:1789302739.240738:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484286848 00000100:00100000:0.0:1789302739.240816:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:0.0:1789302739.240829:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13900:x1876219484286848:12345-192.168.203.42@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789302739.241553:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13900:x1876219484286848:12345-192.168.203.42@tcp:501:mount.lustre.0 Request processed in 723us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302739.241563:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 99 00000100:00100000:1.0:1789302739.246019:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.247597:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484286976 00000100:00100000:3.0:1789302739.247615:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484286976 00000100:00100000:3.0:1789302739.247708:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:3.0:1789302739.247730:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13900:x1876219484286976:12345-192.168.203.42@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789302739.248079:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13900:x1876219484286976:12345-192.168.203.42@tcp:503:mount.lustre.0 Request processed in 351us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.248089:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 100 00000100:00100000:1.0:1789302739.254409:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302739.255565:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484287104 00000100:00100000:0.0:1789302739.255581:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484287104 00000100:00100000:0.0:1789302739.255668:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 101 00000100:00100000:0.0:1789302739.255681:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13910:x1876219484287104:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789302739.256522:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13910:x1876219484287104:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 836us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302739.256533:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 101 00000100:00100000:1.0:1789302739.263420:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302739.263530:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484287232 00000100:00100000:2.0:1789302739.263544:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484287232 00000100:00100000:2.0:1789302739.263614:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 102 00000100:00100000:2.0:1789302739.263628:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13910:x1876219484287232:12345-192.168.203.42@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789302739.264001:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13910:x1876219484287232:12345-192.168.203.42@tcp:502:llog_process_th.0 Request processed in 375us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302739.264011:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 102 00000100:00100000:1.0:1789302739.280850:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302739.280896:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302739.280939:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302739.281332:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484287360 00000100:00100000:0.0:1789302739.281346:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484287360 00000100:00100000:0.0:1789302739.281398:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484287744 00000100:00100000:0.0:1789302739.281419:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484287744 00000100:00100000:0.0:1789302739.281461:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:0.0:1789302739.281474:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:2354:x1876219484287744:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302739.281578:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:2354:x1876219484287744:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 106us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302739.281587:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:0.0:1789302739.281610:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:0.0:1789302739.281615:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1876219484287360:12345-192.168.203.42@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789302739.281647:0:14485:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 978d6a6b-21a1-4e1a-89ae-c587d417fa88@192.168.203.42@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1789302739.281694:0:14485:0:(genops.c:1384:class_connect()) connect: client 978d6a6b-21a1-4e1a-89ae-c587d417fa88, cookie 0x20be524657f1292c 00000004:00100000:0.0:1789302739.281736:0:14485:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789302739.281890:0:14485:0:(import.c:65:import_set_state_nolock()) ffff9a6903576800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789302739.281925:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2350:x1876219484287360:12345-192.168.203.42@tcp:38:mount.lustre.0 Request processed in 308us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302739.281933:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:1.0:1789302739.287666:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.299590:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484288000 00000100:00100000:3.0:1789302739.299612:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484288000 00000100:00100000:1.0:1789302739.299806:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302739.299851:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.299979:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484287616 00000100:00100000:3.0:1789302739.299983:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484287616 00000100:00100000:3.0:1789302739.300059:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484287488 00000100:00100000:3.0:1789302739.300073:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484287488 00000100:00100000:3.0:1789302739.300353:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:3.0:1789302739.300367:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+7:13900:x1876219484287616:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789302739.300410:0:14485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789302739.300496:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+7:13900:x1876219484287616:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 133us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.300505:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:3.0:1789302739.300527:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:3.0:1789302739.300534:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:0:x1876219484287488:12345-192.168.203.42@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789302739.300564:0:14485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789302739.300588:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:0:x1876219484287488:12345-192.168.203.42@tcp:41:mount.lustre.0 Request processed in 54us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.300596:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00080000:1.0:1789302739.305508:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302739.306109:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484287872 00000100:00100000:0.0:1789302739.306130:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484287872 00000100:00100000:1.0:1789302739.311232:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.311435:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484288128 00000100:00100000:3.0:1789302739.311449:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484288128 00000100:00100000:3.0:1789302739.311529:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:3.0:1789302739.311543:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:13900:x1876219484288128:12345-192.168.203.42@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789302739.311647:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:13900:x1876219484288128:12345-192.168.203.42@tcp:40:mount.lustre.0 Request processed in 107us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.311656:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789302739.314132:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:2.0:1789302739.314151:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2354:x1876219484288000:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302739.314252:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2354:x1876219484288000:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 106us (33312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302739.314261:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:2.0:1789302739.321933:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:2.0:1789302739.321951:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2354:x1876219484287872:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302739.322252:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2354:x1876219484287872:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 304us (34602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302739.322263:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:1.0:1789302739.324552:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302739.324598:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302739.324634:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.324717:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484288256 00000100:00100000:3.0:1789302739.324741:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484288256 00000100:00100000:3.0:1789302739.324799:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484288384 00000100:00100000:3.0:1789302739.324803:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484288384 00000100:00100000:3.0:1789302739.324827:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:3.0:1789302739.324838:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876219484288256:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789302739.324884:0:15728:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 978d6a6b-21a1-4e1a-89ae-c587d417fa88@192.168.203.42@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:3.0:1789302739.324929:0:15728:0:(genops.c:1384:class_connect()) connect: client 978d6a6b-21a1-4e1a-89ae-c587d417fa88, cookie 0x20be524657f12933 00002000:00100000:3.0:1789302739.324949:0:15728:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 978d6a6b-21a1-4e1a-89ae-c587d417fa88/ffff9a6906123800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789302739.324976:0:15728:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789302739.325153:0:15728:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789302739.325194:0:15728:0:(import.c:65:import_set_state_nolock()) ffff9a6906127800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302739.325277:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2350:x1876219484288256:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 439us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.325355:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:3.0:1789302739.325378:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:3.0:1789302739.325385:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876219484288384:12345-192.168.203.42@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789302739.325404:0:15728:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 978d6a6b-21a1-4e1a-89ae-c587d417fa88@192.168.203.42@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:3.0:1789302739.325423:0:15728:0:(genops.c:1384:class_connect()) connect: client 978d6a6b-21a1-4e1a-89ae-c587d417fa88, cookie 0x20be524657f1293a 00002000:00100000:3.0:1789302739.325430:0:15728:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 978d6a6b-21a1-4e1a-89ae-c587d417fa88/ffff9a6906122800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789302739.325438:0:15728:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789302739.325501:0:15728:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789302739.325520:0:15728:0:(import.c:65:import_set_state_nolock()) ffff9a6906133800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789302739.325546:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2350:x1876219484288384:12345-192.168.203.42@tcp:8:mount.lustre.0 Request processed in 160us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.325554:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:0.0:1789302739.326344:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484288512 00000100:00100000:0.0:1789302739.326355:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484288512 00000100:00100000:0.0:1789302739.326411:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:0.0:1789302739.326422:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:13900:x1876219484288512:12345-192.168.203.42@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789302739.326511:0:14488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789302739.326591:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:13900:x1876219484288512:12345-192.168.203.42@tcp:33:mount.lustre.0 Request processed in 171us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302739.326599:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:1.0:1789302739.567479:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302739.567631:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484288640 00000100:00100000:3.0:1789302739.567644:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484288640 00000100:00100000:3.0:1789302739.567732:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789302739.567750:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:13931:x1876219484288640:12345-192.168.203.42@tcp:101:mkdir.0 00010000:00010000:3.0:1789302739.567777:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302739.567807:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3ad5 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.567890:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.567907:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.567944:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302739.568000:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789302739.568004:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302739.568028:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.568068:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 8 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.568093:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 7 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302739.568103:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a690a0ce300) 00010000:00010000:3.0:1789302739.568106:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302739.568110:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7400, rc 0) 00000100:00100000:3.0:1789302739.568188:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+7:13931:x1876219484288640:12345-192.168.203.42@tcp:101:mkdir.0 Request processed in 446us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302739.568196:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00010000:00010000:2.0:1789302739.918070:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302740.879036:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505248128:0@lo:400:kworker.0 00000100:00100000:2.0:1789302740.879113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302740.879180:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505248640:0@lo:400:kworker.0 00000100:00100000:2.0:1789302740.879204:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302740.879232:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302740.879237:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505248256:0@lo:400:kworker.0 00000100:00100000:2.0:1789302740.879277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302740.879470:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505248128 00000100:00100000:2.0:1789302740.879479:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505248128 00000100:00100000:2.0:1789302740.879533:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505248256 00000100:00100000:2.0:1789302740.879537:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505248256 00000100:00100000:2.0:1789302740.879562:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302740.879571:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505248128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302740.879769:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505248000:0@lo:400:kworker.0 00000100:00100000:0.0:1789302740.879814:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302740.879844:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505248512:0@lo:400:kworker.0 00000100:00100000:0.0:1789302740.879866:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302740.879887:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789302740.879893:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505248384:0@lo:400:kworker.0 00000100:00100000:0.0:1789302740.879914:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302740.879948:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505248000 00000100:00100000:0.0:1789302740.879953:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505248000 00000100:00100000:0.0:1789302740.879984:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789302740.879992:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3304:x1876219505248000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302740.880041:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3304:x1876219505248000:12345-0@lo:400:kworker.0 Request processed in 50us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302740.880047:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789302740.880092:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505248640 00000100:00100000:0.0:1789302740.880095:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505248640 00000100:00100000:0.0:1789302740.880127:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505248512 00000100:00100000:0.0:1789302740.880131:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505248512 00000100:00100000:0.0:1789302740.880146:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505248384 00000100:00100000:0.0:1789302740.880149:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505248384 00000100:00100000:0.0:1789302740.880162:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789302740.880168:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505248640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302740.880206:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505248640:12345-0@lo:400:kworker.0 Request processed in 38us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302740.880212:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789302740.880226:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789302740.880232:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505248512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789302740.880258:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505248512:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302740.880271:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789302740.880284:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789302740.880307:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505248384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302740.885190:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505248000:0@lo:400:kworker.0 00000100:00100000:1.0:1789302740.885212:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505248512:0@lo:400:kworker.0 00000100:00100000:1.0:1789302740.885252:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505248640:0@lo:400:kworker.0 00000100:00100000:2.0:1789302740.886562:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789302740.886591:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505248256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302740.886682:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505248256:12345-0@lo:400:kworker.0 Request processed in 97us (7403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302740.886689:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789302740.886714:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302740.886719:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789302740.886722:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302740.886761:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505248128:12345-0@lo:400:kworker.0 Request processed in 7192us (7648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302740.886767:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302740.887816:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505248384:12345-0@lo:400:kworker.0 Request processed in 7505us (7897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302740.887826:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789302740.887866:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505248768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302740.887905:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302740.887945:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505248768 00000100:00100000:0.0:1789302740.887952:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505248768 00000100:00100000:0.0:1789302740.887983:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302740.887990:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505248768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302740.888014:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302740.888045:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876219505248768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302740.888063:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789302740.888091:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789302740.888109:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68053d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1876219505248768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302740.888385:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505248384:0@lo:400:kworker.0 00000100:00100000:2.0:1789302740.897422:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505248256:0@lo:400:kworker.0 00000100:00100000:2.0:1789302740.897440:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505248128:0@lo:400:kworker.0 00010000:00010000:1.0:1789302740.953974:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789302740.989355:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec38e548-5fa9-4016-a7ed-50e11bf82d59 00000001:00100000:2.0:1789302740.989374:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 978d6a6b-21a1-4e1a-89ae-c587d417fa88 00000001:00100000:2.0:1789302741.469464:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 978d6a6b-21a1-4e1a-89ae-c587d417fa88 00000001:00100000:2.0:1789302741.469488:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec38e548-5fa9-4016-a7ed-50e11bf82d59 00000001:00100000:1.0:1789302741.479671:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec38e548-5fa9-4016-a7ed-50e11bf82d59 00000001:00100000:1.0:1789302741.479693:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 978d6a6b-21a1-4e1a-89ae-c587d417fa88 00010000:00010000:2.0:1789302741.966143:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302742.413712:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302742.413742:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505248896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302742.413833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302742.414194:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505248896 00000100:00100000:0.0:1789302742.414205:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505248896 00000100:00100000:0.0:1789302742.414310:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789302742.414323:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505248896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789302742.414370:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302742.414438:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505248896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302742.414465:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789302742.414529:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505248896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789302742.414671:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789302742.752210:0:16451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789302742.989570:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789302744.018919:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302744.428440:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302744.428480:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302744.428519:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302744.428549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302744.428569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302744.428585:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302744.428608:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302744.428641:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484289152 00000100:00100000:3.0:1789302744.428653:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484289152 00000100:00100000:1.0:1789302744.428848:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484288896 00000100:00100000:1.0:1789302744.428854:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484288896 00000100:00100000:3.0:1789302744.428925:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484289408 00000100:00100000:3.0:1789302744.428929:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484289408 00000100:00100000:0.0:1789302744.428985:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484289024 00000100:00100000:0.0:1789302744.428990:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484289024 00000100:00100000:2.0:1789302744.430723:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484289280 00000100:00100000:2.0:1789302744.430737:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484289280 00000100:00100000:2.0:1789302744.430809:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:2.0:1789302744.430820:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2352:x1876219484289280:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302744.430917:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2352:x1876219484289280:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 98us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302744.430926:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:2.0:1789302744.430953:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484289536 00000100:00100000:2.0:1789302744.430957:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484289536 00000100:00100000:2.0:1789302744.430976:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:2.0:1789302744.430982:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2352:x1876219484289152:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302744.431008:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2352:x1876219484289152:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 26us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302744.431014:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:2.0:1789302744.431037:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:2.0:1789302744.431044:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2352:x1876219484289536:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302744.431067:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2352:x1876219484289536:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 24us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302744.431072:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:2.0:1789302744.431092:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484288768 00000100:00100000:2.0:1789302744.431149:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484288768 00000100:00100000:2.0:1789302744.431184:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:2.0:1789302744.431190:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:2352:x1876219484288768:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302744.431214:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:2352:x1876219484288768:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (2665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302744.431237:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 104 00000100:00100000:1.0:1789302744.431570:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789302744.431579:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2352:x1876219484288896:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302744.431613:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2352:x1876219484288896:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 36us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302744.431619:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:3.0:1789302744.432371:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:3.0:1789302744.432382:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2352:x1876219484289408:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:3.0:1789302744.432420:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2352:x1876219484289408:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 41us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302744.432427:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00080000:3.0:1789302744.432454:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302744.432460:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789302744.432463:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789302744.432793:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:0.0:1789302744.432802:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2352:x1876219484289024:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302744.432839:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2352:x1876219484289024:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 39us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302744.432845:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00010000:00010000:2.0:1789302745.039347:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302745.997607:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789302745.997635:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505249024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789302745.997721:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789302745.997804:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505249024 00000100:00100000:0.0:1789302745.997817:0:15171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505249024 00000100:00100000:0.0:1789302745.997906:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789302745.997929:0:15171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505249024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789302745.997977:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789302745.998041:0:15171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505249024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302745.998049:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789302745.998534:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505249152:0@lo:400:kworker.0 00000100:00100000:2.0:1789302745.998577:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302745.998608:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505249664:0@lo:400:kworker.0 00000100:00100000:2.0:1789302745.998634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302745.998656:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789302745.998662:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505249280:0@lo:400:kworker.0 00000100:00100000:2.0:1789302745.998685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789302745.998734:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302745.998754:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505249280 00000100:00100000:2.0:1789302745.998759:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505249280 00000100:00100000:2.0:1789302745.998800:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789302745.998808:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505249280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302745.998851:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505249280:12345-0@lo:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302745.998858:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789302745.998879:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302745.998908:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505249280:0@lo:400:kworker.0 00000100:00100000:1.0:1789302745.999077:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505249536:0@lo:400:kworker.0 00000100:00100000:1.0:1789302745.999111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302745.999143:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789302745.999149:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505249408:0@lo:400:kworker.0 00000100:00100000:1.0:1789302745.999171:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302745.999228:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505249152 00000100:00100000:1.0:1789302745.999232:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505249152 00000100:00100000:1.0:1789302745.999264:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302745.999271:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3305:x1876219505249152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302745.999340:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3305:x1876219505249152:12345-0@lo:400:kworker.0 Request processed in 69us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302745.999347:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789302745.999377:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505249664 00000100:00100000:1.0:1789302745.999380:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505249664 00000100:00100000:1.0:1789302745.999409:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505249536 00000100:00100000:1.0:1789302745.999433:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505249536 00000100:00100000:1.0:1789302745.999452:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505249408 00000100:00100000:1.0:1789302745.999454:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505249408 00000100:00100000:1.0:1789302745.999468:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302745.999473:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505249664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302745.999506:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876219505249664:12345-0@lo:400:kworker.0 Request processed in 33us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302745.999512:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302745.999525:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302745.999530:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505249536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302745.999561:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876219505249536:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302745.999568:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302745.999579:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302745.999585:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505249408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302745.999611:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876219505249408:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302745.999618:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789302745.999655:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876219505249408:0@lo:400:kworker.0 00000100:00100000:1.0:1789302745.999665:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1876219505249536:0@lo:400:kworker.0 00000100:00100000:0.0:1789302746.000190:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505249024:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789302746.000230:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789302746.000249:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:57a3ba4d-eae9-4780-ad89-641003f4f604:3305:1876219505249152:0@lo:400:kworker.0 00000100:00100000:0.0:1789302746.000261:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1876219505249664:0@lo:400:kworker.0 00010000:00010000:3.0:1789302746.064392:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789302746.742623:0:16600:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcebeaad90 20000000:00000080:2.0:1789302746.742639:0:16600:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6805b6b800 uarg=0000000000000000 20000000:01000000:2.0:1789302746.742673:0:16600:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789302746.742678:0:16600:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789302746.742682:0:16600:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789302746.744573:0:16601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789302746.744801:0:16600:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789302746.760887:0:16600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789302746.761393:0:16600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761419:0:16600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1263f expref: 18 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761429:0:16600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f1268c expref: 18 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761447:0:16600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f127c7 expref: 18 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761462:0:16600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761471:0:16600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761479:0:16600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761539:0:16600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761559:0:16600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 12 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302746.761577:0:16600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807256a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505249792:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302746.761714:0:16600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.761738:0:16600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 12 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302746.762431:0:16600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807257b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505249920:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302746.762522:0:16600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f127c7 expref: 18 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.762534:0:16600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f127c7 expref: 18 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302746.762545:0:16600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505250048:0@lo:104: 00000100:00100000:2.0:1789302746.762588:0:16600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302746.762629:0:16600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1268c expref: 18 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.762638:0:16600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1268c expref: 18 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302746.762649:0:16600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505250176:0@lo:104: 00000100:00100000:2.0:1789302746.763982:0:16600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789302746.764122:0:16600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x20be524657f1263f expref: 18 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302746.764137:0:16600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x20be524657f1263f expref: 18 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302746.764150:0:16600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c370000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505250304:0@lo:104: 00000100:00100000:2.0:1789302746.764199:0:16600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302746.764230:0:16600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789302746.764565:0:14470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789302746.764581:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505250048 00000100:00100000:3.0:1789302746.764590:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505250048 00000100:00100000:3.0:1789302746.764633:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505250176 00000100:00100000:3.0:1789302746.764636:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505250176 00000100:00100000:3.0:1789302746.764643:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505250304 00000100:00100000:3.0:1789302746.764644:0:14470:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505250304 00000100:00100000:3.0:1789302746.764655:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302746.764665:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+5:16600:x1876219505250048:12345-0@lo:104: 00010000:00010000:3.0:1789302746.764680:0:14470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.764764:0:14470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789302746.764770:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+5:16600:x1876219505250048:12345-0@lo:104: Request processed in 106us (2183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302746.764777:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302746.764794:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302746.764799:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+4:16600:x1876219505250176:12345-0@lo:104: 00010000:00010000:3.0:1789302746.764806:0:14470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.764834:0:14470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789302746.764838:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+4:16600:x1876219505250176:12345-0@lo:104: Request processed in 40us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302746.764843:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302746.764853:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789302746.764857:0:14470:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693d8ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+3:16600:x1876219505250304:12345-0@lo:104: 00010000:00010000:3.0:1789302746.764863:0:14470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.764888:0:14470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789302746.764892:0:14470:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693d8ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:57a3ba4d-eae9-4780-ad89-641003f4f604+3:16600:x1876219505250304:12345-0@lo:104: Request processed in 35us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302746.764897:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789302746.764951:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789302746.764959:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.764977:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302746.764981:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.764990:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302746.764997:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302746.765003:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302746.765049:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765057:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302746.765076:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765083:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a692aba7000/0x20be524657f127c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f127ce expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765097:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789302746.765099:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765104:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8600 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302746.765107:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765122:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302746.765128:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302746.765134:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302746.765144:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765149:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302746.765162:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765168:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69033f8600/0x20be524657f1268c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f12693 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765175:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789302746.765178:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765183:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9000 already unused, calling callback (ffffffffc1a60c20) 10000000:00010000:3.0:1789302746.765186:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765192:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789302746.765197:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789302746.765208:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789302746.765218:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765223:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789302746.765228:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765234:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.142@tcp lock: ffff9a69033f9000/0x20be524657f1263f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x20be524657f12646 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765247:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302746.765248:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302746.765249:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302746.765256:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302746.765261:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302746.765282:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505250688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302746.765351:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302746.765380:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789302746.765385:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505250560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302746.765400:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302746.765433:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505250688 00000100:00100000:3.0:1789302746.765437:0:14473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505250688 00010000:00010000:3.0:1789302746.765458:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1263f expref: 19 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302746.765476:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505250560 00000100:00100000:3.0:1789302746.765478:0:14473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505250560 00010000:00010000:3.0:1789302746.765486:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1268c expref: 20 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302746.765504:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302746.765509:0:14473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+20:3304:x1876219505250688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302746.765521:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302746.765528:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1263f expref: 20 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765542:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1263f expref: 20 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765560:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302746.765809:0:14473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+20:3304:x1876219505250688:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302746.765815:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789302746.765829:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302746.765834:0:14473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3304:x1876219505250560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302746.765841:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302746.765845:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f1268c expref: 19 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765853:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f1268c expref: 19 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.765863:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302746.765878:0:14473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3304:x1876219505250560:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302746.765883:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789302746.766831:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505250560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789302746.766902:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:57a3ba4d-eae9-4780-ad89-641003f4f604:3304:1876219505250688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302746.767373:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57a3ba4d-eae9-4780-ad89-641003f4f604:3306:1876219505250432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789302746.767489:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302746.768318:0:16600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505250048:0@lo:104: 00010000:00010000:2.0:1789302746.768347:0:16600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68049f9600/0x20be524657f12693 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1268c expref: 18 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302746.768374:0:16600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505250176:0@lo:104: 00010000:00010000:2.0:1789302746.768394:0:16600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a692aba7800/0x20be524657f12646 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f1263f expref: 17 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302746.768408:0:16600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c370000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505250304:0@lo:104: 00000100:00100000:3.0:1789302746.769561:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505250432 00000100:00100000:3.0:1789302746.769578:0:14473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505250432 00010000:00010000:3.0:1789302746.769632:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f127c7 expref: 17 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302746.769730:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789302746.769943:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302746.770037:0:16600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807256a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505249792:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302746.770049:0:16600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807257b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16600:1876219505249920:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302746.770091:0:16600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302746.770436:0:14472:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789302746.770557:0:14473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680501d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+17:3306:x1876219505250432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789302746.770580:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302746.770588:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x20be524657f127c7 expref: 17 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.770601:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x20be524657f127c7 expref: 17 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.770621:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68049f8e00/0x20be524657f127ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x20be524657f127c7 expref: 17 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302746.770637:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302746.770698:0:14473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680501d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:57a3ba4d-eae9-4780-ad89-641003f4f604+16:3306:x1876219505250432:12345-0@lo:103:ldlm_bl.0 Request processed in 959us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302746.770706:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789302746.770777:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57a3ba4d-eae9-4780-ad89-641003f4f604:3306:1876219505250432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789302746.771131:0:14472:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789302746.771373:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484289664 00000100:00100000:1.0:1789302746.771381:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484289664 00010000:00010000:1.0:1789302746.771415:0:14472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 13 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302746.771456:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789302746.771465:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:2352:x1876219484289664:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302746.771476:0:14472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302746.771481:0:14472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 13 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.771490:0:14472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 13 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.771503:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69033f8a00/0x20be524657f12925 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aab expref: 13 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.771514:0:14472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302746.771563:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:2352:x1876219484289664:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 99us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302746.771570:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:0.0:1789302746.771890:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302746.771978:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484289792 00000100:00100000:1.0:1789302746.771984:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484289792 00010000:00010000:1.0:1789302746.772002:0:14472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 12 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302746.772044:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:1.0:1789302746.772052:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:2352:x1876219484289792:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302746.772060:0:14472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302746.772064:0:14472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 12 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772085:0:14472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 12 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772096:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68049f9a00/0x20be524657f128ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a49 expref: 12 pid: 14480 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772110:0:14472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772120:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772139:0:14472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772148:0:14472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772155:0:14472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772163:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772170:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9600 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:1.0:1789302746.772175:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.772185:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302746.772381:0:16600:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302746.772391:0:16600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.773607:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.773622:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a69033f9600/0x20be524657f1294f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302746.773642:0:14472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302746.773811:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:2352:x1876219484289792:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 1754us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302746.773822:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00010000:00010000:3.0:1789302747.085761:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302747.533762:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505250816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302747.533855:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302747.534021:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505250816 00000100:00100000:3.0:1789302747.534032:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505250816 00000100:00100000:3.0:1789302747.534121:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789302747.534134:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505250816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789302747.534182:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789302747.535171:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505250816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1036us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302747.535183:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789302747.535218:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302747.535438:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505250816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789302748.109446:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789302748.109606:0:14483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302748.109612:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a69369ec800 from 10 10000000:01000000:1.0:1789302748.109619:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302748.109679:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aba00/0x20be524657f12956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.109693:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69361aba00/0x20be524657f12956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.109706:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69361aba00/0x20be524657f12956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302748.109739:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505250944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.109827:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302748.109898:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69053eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302748.110181:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505250944 00000100:00100000:0.0:1789302748.110191:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505250944 00000100:00100000:0.0:1789302748.110259:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789302748.110269:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+16:14483:x1876219505250944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302748.110323:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302748.110343:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f8800/0x20be524657f1295d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12956 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302748.110374:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f8800/0x20be524657f1295d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12956 expref: 17 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302748.110387:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f8800/0x20be524657f1295d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12956 expref: 17 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302748.110395:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8800, rc 0) 00000100:00100000:0.0:1789302748.110451:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+17:14483:x1876219505250944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302748.110458:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789302748.110701:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505250944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302748.110719:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69361aba00/0x20be524657f12956 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1295d expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.110740:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69361aba00/0x20be524657f12956 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1295d expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302748.110816:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.110850:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302748.110890:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69053eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789302748.110994:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505251072 00000100:00100000:0.0:1789302748.111010:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505251072 00000100:00100000:1.0:1789302748.111123:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789302748.111133:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+17:14483:x1876219505251072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.111640:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+17:14483:x1876219505251072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 506us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302748.111648:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789302748.118433:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789302748.118530:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789302748.118633:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302748.122774:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804bd9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789302748.124009:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505251200 00000100:00100000:1.0:1789302748.124025:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505251200 00000100:00100000:1.0:1789302748.124112:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789302748.124125:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+17:14483:x1876219505251200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.124517:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+17:14483:x1876219505251200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 393us (5883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302748.124527:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789302748.128522:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789302748.140770:0:16634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789302748.141245:0:14483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789302748.141276:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302748.141309:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aba00/0x20be524657f12956 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1295d expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.141324:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361aba00/0x20be524657f12956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1295d expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302748.141356:0:14483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302748.141360:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a693639b000 from 10 10000000:01000000:1.0:1789302748.141363:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302748.141422:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aae00/0x20be524657f12964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.141431:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69361aae00/0x20be524657f12964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.141444:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69361aae00/0x20be524657f12964 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302748.141482:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.141571:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302748.141620:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505251328 00000100:00100000:1.0:1789302748.141628:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505251328 00000100:00100000:1.0:1789302748.143220:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789302748.143782:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+17:14483:x1876219505251328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302748.143982:0:14479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302748.144133:0:14479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361abc00/0x20be524657f1296b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12964 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.144172:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361abc00/0x20be524657f1296b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12964 expref: 18 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.144185:0:14479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361abc00/0x20be524657f1296b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12964 expref: 18 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.144195:0:14479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361abc00, rc 0) 00000100:00100000:1.0:1789302748.146154:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+18:14483:x1876219505251328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2610us (4571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302748.146168:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789302748.146263:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033e2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789302748.146328:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302748.146358:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69361aae00/0x20be524657f12964 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1296b expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.146372:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69361aae00/0x20be524657f12964 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f1296b expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302748.146477:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.146541:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302748.146574:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033e2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302748.148282:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505251456 00000100:00100000:2.0:1789302748.148315:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505251456 00000100:00100000:2.0:1789302748.148394:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789302748.148407:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+18:14483:x1876219505251456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302748.151417:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+18:14483:x1876219505251456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2999us (4861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302748.151437:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789302748.152210:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.152324:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.152402:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302748.152452:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033e2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302748.153421:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505251584 00000100:00100000:2.0:1789302748.153432:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505251584 00000100:00100000:2.0:1789302748.153487:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789302748.153497:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+18:14483:x1876219505251584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302748.153757:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+18:14483:x1876219505251584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302748.153765:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789302748.154171:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789302748.160243:0:16637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789302748.160339:0:14483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789302748.160365:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302748.160379:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361aae00/0x20be524657f12964 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1296b expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.160394:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361aae00/0x20be524657f12964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f1296b expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789302748.160418:0:14483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789302748.160422:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6805068800 from 10 10000000:01000000:1.0:1789302748.160425:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789302748.160475:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361ab400/0x20be524657f12972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.160484:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.142@tcp lock: ffff9a69361ab400/0x20be524657f12972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.160497:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.142@tcp lock: ffff9a69361ab400/0x20be524657f12972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302748.160525:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.160600:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302748.160641:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69033e2900 going to sleep for 11 seconds 00000100:00100000:2.0:1789302748.160864:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505251712 00000100:00100000:2.0:1789302748.160875:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505251712 00000100:00100000:2.0:1789302748.160936:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789302748.160948:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+18:14483:x1876219505251712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302748.160967:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302748.160984:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69033f8a00/0x20be524657f12979 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x20be524657f12972 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302748.161023:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69033f8a00/0x20be524657f12979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x20be524657f12972 expref: 19 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302748.161036:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69033f8a00/0x20be524657f12979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x20be524657f12972 expref: 19 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302748.161054:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8a00, rc 0) 00000100:00100000:2.0:1789302748.161107:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+19:14483:x1876219505251712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302748.161115:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789302748.161170:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789302748.161187:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.142@tcp lock: ffff9a69361ab400/0x20be524657f12972 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12979 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302748.161209:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.142@tcp lock: ffff9a69361ab400/0x20be524657f12972 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x20be524657f12979 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302748.161274:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c373800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302748.161325:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302748.161349:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302748.161362:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505251840 00000100:00100000:2.0:1789302748.161366:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505251840 00000100:00100000:2.0:1789302748.161389:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789302748.161395:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:14483:x1876219505251840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302748.161693:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:57a3ba4d-eae9-4780-ad89-641003f4f604+19:14483:x1876219505251840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302748.161700:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789302748.161731:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c373800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789302748.161763:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c373800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302748.161805:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789302748.161820:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693ff1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789302748.161831:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505251968 00000100:00100000:2.0:1789302748.161834:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505251968 00000100:00100000:2.0:1789302748.161852:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789302748.161858:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+19:14483:x1876219505251968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302748.162030:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+19:14483:x1876219505251968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302748.162038:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789302748.162080:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c373800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:57a3ba4d-eae9-4780-ad89-641003f4f604:14483:1876219505251968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789302748.177872:0:16638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789302748.177989:0:14483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789302748.178026:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.142@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789302748.178041:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.142@tcp lock: ffff9a69361ab400/0x20be524657f12972 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12979 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.178063:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.142@tcp lock: ffff9a69361ab400/0x20be524657f12972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x20be524657f12979 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302748.342245:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302748.342375:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484289920 00000100:00100000:0.0:1789302748.342389:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484289920 00000100:00100000:0.0:1789302748.342465:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:0.0:1789302748.342477:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+11:13784:x1876219484289920:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789302748.342499:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302748.342523:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68049f8000/0x20be524657f12980 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3adc expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302748.342558:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68049f8000/0x20be524657f12980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3adc expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302748.342570:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68049f8000/0x20be524657f12980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3adc expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302748.342581:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8000, rc 0) 00000100:00100000:0.0:1789302748.342651:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13784:x1876219484289920:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 176us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302748.342659:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 115 00000100:00100000:2.0:1789302748.346865:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302748.348180:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484290048 00000100:00100000:0.0:1789302748.348197:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484290048 00000100:00100000:0.0:1789302748.348268:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:0.0:1789302748.348279:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13784:x1876219484290048:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789302748.348662:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13784:x1876219484290048:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 383us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302748.348671:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 116 00000100:00100000:0.0:1789302748.355333:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302748.355399:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484290176 00000100:00100000:0.0:1789302748.355411:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484290176 00000100:00100000:0.0:1789302748.355469:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:0.0:1789302748.355479:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13784:x1876219484290176:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789302748.355744:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13784:x1876219484290176:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 263us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302748.355753:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 117 00000100:00100000:0.0:1789302748.366019:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302748.366151:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484290304 00000100:00100000:1.0:1789302748.366165:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484290304 00000100:00100000:1.0:1789302748.366238:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:1.0:1789302748.366250:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+12:13784:x1876219484290304:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789302748.366318:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302748.366343:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a69361aaa00/0x20be524657f12987 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3ae3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.366380:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a69361aaa00/0x20be524657f12987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ae3 expref: 13 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.366392:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a69361aaa00/0x20be524657f12987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ae3 expref: 13 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302748.366402:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361aaa00, rc 0) 00000100:00100000:1.0:1789302748.366469:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13784:x1876219484290304:12345-192.168.203.42@tcp:101:ll_cfg_requeue.0 Request processed in 222us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302748.366477:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 118 00000100:00100000:0.0:1789302748.387072:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302748.388846:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484290432 00000100:00100000:1.0:1789302748.388867:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484290432 00000100:00100000:1.0:1789302748.388963:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:1.0:1789302748.388977:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13784:x1876219484290432:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789302748.390446:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13784:x1876219484290432:12345-192.168.203.42@tcp:501:ll_cfg_requeue.0 Request processed in 1464us (3380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302748.390460:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 119 00000100:00100000:2.0:1789302748.398077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302748.398128:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484290560 00000100:00100000:2.0:1789302748.398140:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484290560 00000100:00100000:2.0:1789302748.398202:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 120 00000100:00100000:2.0:1789302748.398214:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13784:x1876219484290560:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789302748.398509:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:13784:x1876219484290560:12345-192.168.203.42@tcp:503:ll_cfg_requeue.0 Request processed in 297us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302748.398517:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 120 00000040:00080000:0.0:1789302748.690198:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789302749.133418:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302749.560411:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302749.560450:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302749.560475:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302749.560500:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302749.560517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302749.560539:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302749.560559:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302749.560599:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484291072 00000100:00100000:0.0:1789302749.560612:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484291072 00000100:00100000:2.0:1789302749.560632:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484291328 00000100:00100000:2.0:1789302749.560638:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484291328 00000100:00100000:0.0:1789302749.560687:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484290944 00000100:00100000:2.0:1789302749.560688:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484291456 00000100:00100000:2.0:1789302749.560692:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484291456 00000100:00100000:0.0:1789302749.560694:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484290944 00000100:00100000:2.0:1789302749.560720:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789302749.560729:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2354:x1876219484291328:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302749.560770:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484290816 00000100:00100000:1.0:1789302749.560776:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484290816 00000100:00100000:1.0:1789302749.560814:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484291200 00000100:00100000:1.0:1789302749.560818:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484291200 00000100:00100000:2.0:1789302749.560821:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2354:x1876219484291328:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 91us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302749.560839:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:1.0:1789302749.560848:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2354:x1876219484290816:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302749.560903:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2354:x1876219484290816:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 56us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302749.560912:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:1.0:1789302749.560939:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:1.0:1789302749.560947:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2354:x1876219484291200:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302749.560986:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2354:x1876219484291200:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302749.561001:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:1.0:1789302749.561023:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484290688 00000100:00100000:1.0:1789302749.561027:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484290688 00000100:00100000:1.0:1789302749.561060:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:1.0:1789302749.561066:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:2354:x1876219484290688:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302749.561093:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:2354:x1876219484290688:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302749.561099:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 121 00000100:00100000:2.0:1789302749.561746:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789302749.561770:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:2.0:1789302749.561779:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2354:x1876219484291072:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302749.561820:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2354:x1876219484291072:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 43us (1369us total) trans 0 rc 0/0 00000100:00080000:3.0:1789302749.561828:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302749.561828:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00080000:3.0:1789302749.561837:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789302749.561841:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789302749.561850:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:2.0:1789302749.561870:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2354:x1876219484291456:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302749.561897:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2354:x1876219484291456:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 30us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302749.561904:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:2.0:1789302749.561917:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:2.0:1789302749.561923:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2354:x1876219484290944:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:2.0:1789302749.561948:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2354:x1876219484290944:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 25us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302749.561955:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00010000:00010000:3.0:1789302750.160071:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789302750.949927:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302750.950527:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484291584 00000100:00100000:1.0:1789302750.950539:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484291584 00000100:00100000:1.0:1789302750.950769:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:1.0:1789302750.950782:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:14442:x1876219484291584:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302750.950806:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302750.950829:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1298e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3aea expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.950894:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.950926:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.950941:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.950956:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.950963:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.950970:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953130:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f129a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953150:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f129a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953161:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f129a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302750.953195:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789302750.953199:0:14485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302750.953236:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f129a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953247:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953265:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953272:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953278:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302750.953527:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953537:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953550:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a690a0ce300) 00010000:00010000:1.0:1789302750.953553:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302750.953558:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953565:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f12995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953578:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953584:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953590:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953596:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302750.953606:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953613:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953622:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a69051af700) 00010000:00010000:1.0:1789302750.953625:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302750.953629:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953635:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f1299c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953673:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f1298e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aea expref: 8 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953688:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab200/0x20be524657f129a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aea expref: 7 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.953696:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a69051afd00) 00010000:00010000:1.0:1789302750.953698:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789302750.953700:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69361ab200, rc 0) 00000100:00100000:1.0:1789302750.953774:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:14442:x1876219484291584:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 2995us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302750.953783:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:2.0:1789302750.966063:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302750.966379:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484291840 00000100:00100000:1.0:1789302750.966389:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484291840 00000100:00100000:1.0:1789302750.966444:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:1.0:1789302750.966453:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:14442:x1876219484291840:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302750.966484:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302750.966503:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f129aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3af1 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.966575:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.966589:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.966599:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.966674:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.966682:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.966689:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967055:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f129bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967065:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f129bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967073:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f129bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302750.967083:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789302750.967824:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967834:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967842:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967848:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302750.967852:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967859:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967872:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a69051afd00) 00010000:00010000:1.0:1789302750.967932:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302750.967938:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967944:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa400/0x20be524657f129b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967957:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967963:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.967969:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.968089:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69361aa800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302750.968093:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.968099:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.968108:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a69051af700) 00010000:00010000:1.0:1789302750.968110:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302750.968113:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.968119:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361aa800/0x20be524657f129b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.968848:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69361ab000/0x20be524657f129aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3af1 expref: 10 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.968865:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045800/0x20be524657f129bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3af1 expref: 9 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302750.968872:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69051afb00) 00010000:00010000:1.0:1789302750.968874:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302750.968887:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045800, rc 0) 00000100:00100000:1.0:1789302750.968960:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14442:x1876219484291840:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 2507us (2906us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789302750.968968:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:0.0:1789302750.974047:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302750.976378:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484291968 00000100:00100000:1.0:1789302750.976414:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484291968 00000100:00100000:1.0:1789302750.976492:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:1.0:1789302750.976504:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14442:x1876219484291968:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789302750.977110:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14442:x1876219484291968:12345-192.168.203.42@tcp:59:lhsmtool_posix.0 Request processed in 607us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302750.977119:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:0.0:1789302751.031849:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.032039:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484292096 00000100:00100000:1.0:1789302751.032050:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484292096 00000100:00100000:1.0:1789302751.032122:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:1.0:1789302751.032135:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14448:x1876219484292096:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302751.032157:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302751.032180:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f129cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3af8 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.032247:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.032262:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.032274:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789302751.032282:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789302751.032439:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.032448:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.032456:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033079:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033091:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033169:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033176:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.033180:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033188:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033203:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a690a0ce300) 00010000:00010000:0.0:1789302751.033206:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.033211:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033217:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f129d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033231:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033237:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033243:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033248:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045600 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.033251:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033266:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033275:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a69051af700) 00010000:00010000:0.0:1789302751.033277:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.033280:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033433:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f129db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033473:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f129cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3af8 expref: 10 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033484:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a690a0ce300) 00010000:00010000:0.0:1789302751.033486:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.033490:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f129cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3af8 expref: 10 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.033500:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044a00, rc 0) 00000100:00100000:0.0:1789302751.033573:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14448:x1876219484292096:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1440us (1732us total) trans 0 rc 301/301 00000100:00100000:0.0:1789302751.033581:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:3.0:1789302751.038326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302751.038457:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484292224 00000100:00100000:0.0:1789302751.038480:0:14493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484292224 00000100:00100000:0.0:1789302751.038535:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:0.0:1789302751.038546:0:14493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14448:x1876219484292224:12345-192.168.203.42@tcp:700:lfs.0 00000100:00100000:0.0:1789302751.038647:0:14493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14448:x1876219484292224:12345-192.168.203.42@tcp:700:lfs.0 Request processed in 102us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302751.038655:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:1.0:1789302751.042022:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302751.042082:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484292480 00000100:00100000:2.0:1789302751.042092:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484292480 00000100:00100000:2.0:1789302751.042151:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:2.0:1789302751.042161:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14448:x1876219484292480:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1789302751.042215:0:14485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302751.042243:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12910 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3a73 expref: 9 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.042262:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a690a0ce300) 00010000:00010000:2.0:1789302751.042267:0:14485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302751.042651:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.042667:0:14485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 5 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.042689:0:14485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.042725:0:14485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 5 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.042741:0:14485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 5 pid: 14484 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302751.042757:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c371f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876219505252096:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302751.042850:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690492f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789302751.045891:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c371f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876219505252096:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302751.045917:0:14485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302751.046879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302751.047601:0:16602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484292608 00000100:00100000:2.0:1789302751.047610:0:16602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484292608 00010000:00010000:2.0:1789302751.047694:0:16602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 6 pid: 14484 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302751.047730:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:2.0:1789302751.047737:0:16602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2352:x1876219484292608:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302751.047748:0:16602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302751.047753:0:16602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 6 pid: 14484 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.047762:0:16602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 6 pid: 14484 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.047779:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7400/0x20be524657f12948 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ad5 expref: 6 pid: 14484 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.047801:0:16602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a690a0ce300) 00010000:00010000:2.0:1789302751.047806:0:16602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.047812:0:16602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.047818:0:16602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.047840:0:16602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302751.047883:0:16602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2352:x1876219484292608:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 146us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302751.047888:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00010000:00010000:1.0:1789302751.048277:0:14485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.048310:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.048330:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.048337:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.048343:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789302751.048646:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789302751.049754:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789302751.049768:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.049775:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.049780:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.049792:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302751.049796:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.049801:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.049812:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a690a0ce300) 00010000:00010000:1.0:1789302751.049814:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302751.049817:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.049820:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f129e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302751.049835:0:14485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009be2cd84 reply state 00000000bc42661a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302751.049841:0:14485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789302751.050089:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+10:14448:x1876219484292480:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 7859us (8007us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789302751.050447:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00010000:00010000:3.0:1789302751.052726:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.052743:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.052751:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.052757:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302751.052762:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.052786:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.052802:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a69051afe00) 00010000:00010000:3.0:1789302751.052804:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302751.052809:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.052815:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f129e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302751.121543:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789302751.121574:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505252224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302751.121647:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302751.124796:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505252224 00000100:00100000:1.0:1789302751.124808:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505252224 00000100:00100000:1.0:1789302751.124873:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789302751.124883:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505252224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302751.124918:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302751.125005:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505252224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (3357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302751.125024:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789302751.125138:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505252224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302751.125210:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57a3ba4d-eae9-4780-ad89-641003f4f604:3303:1876219505252352:0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125244:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302751.125314:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505252480:0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302751.125401:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505252608:0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125426:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302751.125466:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505252736:0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302751.125514:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505252608 00000100:00100000:3.0:1789302751.125518:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505252608 00000100:00100000:3.0:1789302751.125543:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505252736 00000100:00100000:3.0:1789302751.125551:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505252736 00000100:00100000:3.0:1789302751.125571:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302751.125576:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505252608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125618:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876219505252608:12345-0@lo:400:kworker.0 Request processed in 42us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302751.125625:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789302751.125637:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302751.125643:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505252736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125670:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505252736:12345-0@lo:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302751.125675:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789302751.125700:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505252736:0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125722:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876219505252608:0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125751:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505252864:0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125769:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302751.125794:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505252864 00000100:00100000:3.0:1789302751.125797:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505252864 00000100:00100000:3.0:1789302751.125814:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302751.125820:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505252864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302751.125849:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505252864:12345-0@lo:400:kworker.0 Request processed in 29us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302751.125854:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789302751.125876:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505252864:0@lo:400:kworker.0 00000100:00100000:2.0:1789302751.128805:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505252352 00000100:00100000:2.0:1789302751.128820:0:14480:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505252352 00000100:00100000:2.0:1789302751.128880:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789302751.128889:0:14480:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3303:x1876219505252352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302751.128989:0:14480:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3303:x1876219505252352:12345-0@lo:400:kworker.0 Request processed in 93us (3736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302751.128996:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789302751.129036:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505252480 00000100:00100000:2.0:1789302751.129041:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505252480 00000100:00100000:2.0:1789302751.129072:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302751.129078:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505252480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789302751.129112:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876219505252480:12345-0@lo:400:kworker.0 Request processed in 35us (3757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302751.129147:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789302751.129188:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:57a3ba4d-eae9-4780-ad89-641003f4f604:3303:1876219505252352:0@lo:400:kworker.0 00000100:00080000:2.0:1789302751.129212:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789302751.129216:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789302751.129219:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789302751.130667:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1876219505252480:0@lo:400:kworker.0 00000100:00100000:2.0:1789302751.152259:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302751.152538:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484292736 00000100:00100000:3.0:1789302751.152548:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484292736 00000100:00100000:3.0:1789302751.152599:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:3.0:1789302751.152608:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:14456:x1876219484292736:12345-192.168.203.42@tcp:101:lctl.0 00010000:00010000:3.0:1789302751.152631:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302751.152653:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f129f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3aff expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.152716:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f129f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.152742:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f129f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.152752:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f129f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302751.152785:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789302751.152789:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302751.152827:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f129f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.152850:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f129f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aff expref: 11 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.152866:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7000/0x20be524657f129f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3aff expref: 10 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.152873:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:3.0:1789302751.152889:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789302751.152893:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba7000, rc 0) 00000100:00100000:3.0:1789302751.152951:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+10:14456:x1876219484292736:12345-192.168.203.42@tcp:101:lctl.0 Request processed in 343us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302751.152958:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00010000:00010000:3.0:1789302751.181461:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789302751.207090:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302751.207227:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484292864 00000100:00100000:2.0:1789302751.207238:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484292864 00000100:00100000:2.0:1789302751.207313:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:2.0:1789302751.207324:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:14457:x1876219484292864:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302751.207354:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302751.207375:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f129fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b06 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.207445:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f12a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.207458:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f12a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.207469:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f12a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302751.207502:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789302751.207506:0:14485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302751.207527:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f12a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.207549:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f129fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b06 expref: 7 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.207579:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8600/0x20be524657f12a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b06 expref: 6 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.207588:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:2.0:1789302751.207591:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302751.207595:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8600, rc 0) 00000100:00100000:2.0:1789302751.207657:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:14457:x1876219484292864:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 336us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302751.207665:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:2.0:1789302751.217010:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302751.219059:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484292992 00000100:00100000:0.0:1789302751.219074:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484292992 00000100:00100000:0.0:1789302751.219273:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:0.0:1789302751.219298:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:14457:x1876219484292992:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302751.219321:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302751.219351:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12a0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b0d expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219423:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219438:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219450:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219465:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219472:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219479:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219574:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9600/0x20be524657f12a21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219595:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9600/0x20be524657f12a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219602:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9600/0x20be524657f12a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302751.219630:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789302751.219634:0:14486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302751.219648:0:14486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9600/0x20be524657f12a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219660:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219666:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219672:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219678:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.219681:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219689:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219700:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:0.0:1789302751.219703:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.219708:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219722:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219735:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219741:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219746:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219751:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.219753:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219759:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219765:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a690a0cea00) 00010000:00010000:0.0:1789302751.219767:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.219770:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219775:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219801:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b0d expref: 8 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219823:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9600/0x20be524657f12a21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b0d expref: 7 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.219830:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a690a0ce500) 00010000:00010000:0.0:1789302751.219832:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789302751.219834:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f9600, rc 0) 00000100:00100000:0.0:1789302751.219899:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+7:14457:x1876219484292992:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 618us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302751.219906:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 22 00000100:00100000:1.0:1789302751.223410:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302751.236672:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484293248 00000100:00100000:2.0:1789302751.236686:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484293248 00000100:00100000:2.0:1789302751.236750:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:2.0:1789302751.236759:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+7:14457:x1876219484293248:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302751.236778:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302751.236941:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12a28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b14 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302751.237037:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789302751.237327:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12a28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b14 expref: 9 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.237721:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:2.0:1789302751.237726:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302751.237733:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12a28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b14 expref: 9 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.237766:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9e00, rc 0) 00000100:00100000:2.0:1789302751.237830:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+8:14457:x1876219484293248:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1071us (14435us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789302751.237838:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 23 00000100:00100000:1.0:1789302751.246762:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302751.246856:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484293504 00000100:00100000:2.0:1789302751.246871:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484293504 00000100:00100000:2.0:1789302751.246958:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 24 00000100:00100000:2.0:1789302751.246971:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+8:14457:x1876219484293504:12345-192.168.203.42@tcp:36:lfs.0 00010000:00010000:2.0:1789302751.247154:0:14485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302751.247191:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9600/0x20be524657f12a21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b0d expref: 8 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.247213:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a690a0ce500) 00010000:00010000:2.0:1789302751.247228:0:14485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302751.247258:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.247274:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.247474:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302751.247735:0:14485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8c2ba27 reply state 00000000a94d2790 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302751.247746:0:14485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789302751.247772:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789302751.247889:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+9:14457:x1876219484293504:12345-192.168.203.42@tcp:36:lfs.0 Request processed in 915us (1139us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789302751.247898:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 24 00010000:00010000:0.0:1789302751.250084:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.250106:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.250115:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.250122:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.250128:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.250137:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.250155:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68600) 00010000:00010000:0.0:1789302751.250159:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789302751.250164:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.250189:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12a36 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302751.250974:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302751.251143:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484293760 00000100:00100000:0.0:1789302751.251155:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484293760 00000100:00100000:0.0:1789302751.251256:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:0.0:1789302751.251269:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+8:14457:x1876219484293760:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789302751.251586:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+9:14457:x1876219484293760:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 320us (757us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789302751.251595:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:1.0:1789302751.253849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302751.253973:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484294016 00000100:00100000:0.0:1789302751.253996:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484294016 00000100:00100000:0.0:1789302751.254134:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:0.0:1789302751.254146:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+9:14457:x1876219484294016:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302751.254179:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302751.254205:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b1b expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254374:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254391:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254404:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254419:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254444:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254451:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302751.254595:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789302751.254708:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254717:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254724:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254731:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.254737:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254747:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254761:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:0.0:1789302751.254764:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.254770:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254776:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254803:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254809:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254815:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254821:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.254824:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254831:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254839:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a690a0cea00) 00010000:00010000:0.0:1789302751.254841:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.254844:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254850:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.254965:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b1b expref: 11 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.255130:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:0.0:1789302751.255134:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302751.255145:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b1b expref: 11 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.255157:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8c00, rc 0) 00000100:00100000:0.0:1789302751.255240:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+10:14457:x1876219484294016:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1096us (1405us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789302751.255249:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 25 00000100:00100000:3.0:1789302751.259026:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302751.259135:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484294144 00000100:00100000:2.0:1789302751.259150:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484294144 00000100:00100000:2.0:1789302751.259273:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:2.0:1789302751.259304:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+10:14457:x1876219484294144:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:2.0:1789302751.259338:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302751.259366:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12a59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b22 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.259473:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.259490:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.259503:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302751.259533:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789302751.259536:0:14485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302751.259557:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.259586:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12a59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 12 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.259606:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 11 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.259631:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:2.0:1789302751.259634:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302751.259639:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9600, rc 0) 00000100:00100000:2.0:1789302751.259706:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+11:14457:x1876219484294144:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 425us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302751.259713:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 26 00000100:00100000:1.0:1789302751.263233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302751.263311:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484294272 00000100:00100000:0.0:1789302751.263325:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484294272 00000100:00100000:0.0:1789302751.263386:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:0.0:1789302751.263396:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+11:14457:x1876219484294272:12345-192.168.203.42@tcp:37:lfs.0 00000100:00100000:1.0:1789302751.267085:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+11:14457:x1876219484294272:12345-192.168.203.42@tcp:37:lfs.0 Request processed in 3674us (3850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302751.267102:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 3 00000100:00100000:3.0:1789302751.287143:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.287239:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484294528 00000100:00100000:1.0:1789302751.287254:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484294528 00000100:00100000:1.0:1789302751.287361:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789302751.287374:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690b98d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+11:14457:x1876219484294528:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302751.287728:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690b98d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:978d6a6b-21a1-4e1a-89ae-c587d417fa88+12:14457:x1876219484294528:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 356us (599us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789302751.287737:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 4 00000100:00100000:1.0:1789302751.344749:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302751.345042:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484294656 00000100:00100000:0.0:1789302751.345057:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484294656 00000100:00100000:0.0:1789302751.345135:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:0.0:1789302751.345147:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+10:14463:x1876219484294656:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:0.0:1789302751.345173:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302751.345202:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b29 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345332:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345350:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345363:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345381:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345407:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345414:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345528:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8a00/0x20be524657f12a7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345536:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8a00/0x20be524657f12a7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345543:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8a00/0x20be524657f12a7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302751.345577:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789302751.345582:0:14486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789302751.345625:0:14486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8a00/0x20be524657f12a7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345652:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345855:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345863:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345870:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.345875:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345891:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345905:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:0.0:1789302751.345908:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.345915:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345921:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12a6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345937:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345944:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345950:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345955:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.345958:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345964:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.345971:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a690a0cea00) 00010000:00010000:0.0:1789302751.345974:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789302751.345985:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.346000:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12a75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.346036:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12a67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b29 expref: 12 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.346050:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8a00/0x20be524657f12a7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b29 expref: 11 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.346057:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:0.0:1789302751.346059:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789302751.346062:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8a00, rc 0) 00000100:00100000:1.0:1789302751.351571:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+11:14463:x1876219484294656:12345-192.168.203.42@tcp:101:bash.0 Request processed in 6407us (6817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302751.351589:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 27 00000100:00100000:2.0:1789302751.364518:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.365117:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484294912 00000100:00100000:1.0:1789302751.365131:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484294912 00000100:00100000:3.0:1789302751.365342:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 28 00000100:00100000:3.0:1789302751.365358:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+11:14463:x1876219484294912:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:3.0:1789302751.365386:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302751.365414:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12a83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b30 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.365566:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.365584:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 11 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.365594:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.365651:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 11 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.366366:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 11 pid: 14485 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302751.366414:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a69362f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14484:1876219505252992:192.168.203.42@tcp:104: 00000100:00100000:3.0:1789302751.367856:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789302751.370898:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.371716:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a69362f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14484:1876219505252992:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302751.371752:0:14484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302751.373488:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484295040 00000100:00100000:0.0:1789302751.373509:0:14473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484295040 00010000:00010000:0.0:1789302751.373576:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 12 pid: 14485 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302751.373736:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:0.0:1789302751.373750:0:14473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+12:2351:x1876219484295040:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302751.373772:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302751.373780:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 12 pid: 14485 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.373795:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 12 pid: 14485 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.373823:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9600/0x20be524657f12a60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b22 expref: 12 pid: 14485 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.373861:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:0.0:1789302751.373868:0:14473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.374150:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.374161:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.374277:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302751.374542:0:14473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+11:2351:x1876219484295040:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 793us (3654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302751.374552:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00010000:00010000:1.0:1789302751.376805:0:14484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.376826:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.376868:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.376894:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.376907:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.378806:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.378832:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.378845:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302751.378858:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789302751.378987:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.378995:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.379004:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.379831:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6800 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302751.379838:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.379847:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.379865:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:1.0:1789302751.379868:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302751.379873:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.380744:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6800/0x20be524657f12a8a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789302751.380771:0:14484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000904982fa reply state 00000000e747d655 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302751.380780:0:14484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789302751.380847:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7a00/0x20be524657f12a83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 14 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.380864:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 13 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.380872:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302751.380886:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789302751.380890:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044600, rc 0) 00000100:00100000:1.0:1789302751.380989:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+14:14463:x1876219484294912:12345-192.168.203.42@tcp:101:bash.0 Request processed in 15624us (16477us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789302751.381026:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 28 00010000:00010000:3.0:1789302751.393901:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.393923:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.393932:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.393940:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302751.393946:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.393956:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.393988:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a69051af100) 00010000:00010000:3.0:1789302751.393992:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302751.393998:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.394005:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12a91 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302751.408240:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.408601:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484295168 00000100:00100000:1.0:1789302751.408617:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484295168 00000100:00100000:1.0:1789302751.408711:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:1.0:1789302751.408724:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+13:14463:x1876219484295168:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302751.408759:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302751.408788:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12aa6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b37 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.408876:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f12aad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.408893:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f12aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.408906:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f12aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302751.408964:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789302751.408969:0:14486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302751.409003:0:14486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f12aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.409015:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f12aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.409042:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12aa6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b37 expref: 15 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.409066:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f12aad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b37 expref: 14 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.409091:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302751.409094:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302751.409099:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045000, rc 0) 00000100:00100000:1.0:1789302751.409179:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+14:14463:x1876219484295168:12345-192.168.203.42@tcp:101:bash.0 Request processed in 457us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302751.409186:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 29 00000100:00100000:1.0:1789302751.415935:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302751.416097:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484295424 00000100:00100000:0.0:1789302751.416110:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484295424 00000100:00100000:0.0:1789302751.416179:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:0.0:1789302751.416191:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+14:14463:x1876219484295424:12345-192.168.203.42@tcp:35:bash.0 00000100:00100000:0.0:1789302751.416645:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+15:14463:x1876219484295424:12345-192.168.203.42@tcp:35:bash.0 Request processed in 453us (723us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789302751.416654:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 5 00000100:00100000:0.0:1789302751.502688:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.502786:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484295680 00000100:00100000:1.0:1789302751.502802:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484295680 00000100:00100000:1.0:1789302751.502881:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:1.0:1789302751.502894:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+15:14473:x1876219484295680:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302751.502927:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302751.502955:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b3e expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302751.503104:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789302751.503261:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12ab4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b3e expref: 17 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.503278:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:1.0:1789302751.503281:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302751.503318:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b3e expref: 17 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.503336:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045e00, rc 0) 00000100:00100000:1.0:1789302751.503415:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+16:14473:x1876219484295680:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 523us (741us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789302751.503440:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:2.0:1789302751.510028:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.510144:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484295936 00000100:00100000:1.0:1789302751.510164:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484295936 00000100:00100000:1.0:1789302751.510266:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:1.0:1789302751.510280:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+16:14473:x1876219484295936:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302751.510693:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+17:14473:x1876219484295936:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 414us (679us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789302751.510704:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 6 00000100:00100000:2.0:1789302751.563443:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.564817:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484296192 00000100:00100000:1.0:1789302751.564834:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484296192 00000100:00100000:1.0:1789302751.564927:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:1.0:1789302751.564940:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+17:14476:x1876219484296192:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302751.565103:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302751.565134:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12ac2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b45 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.565263:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12ac9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.565280:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.565470:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302751.565486:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789302751.565786:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12ac2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b45 expref: 20 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.565827:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b45 expref: 19 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.565837:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302751.565840:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302751.565845:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045200, rc 0) 00000100:00100000:1.0:1789302751.566004:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+19:14476:x1876219484296192:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 1066us (2575us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789302751.566015:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 31 00000100:00100000:3.0:1789302751.580737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302751.580813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302751.581075:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484296320 00000100:00100000:0.0:1789302751.581088:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484296320 00000100:00100000:0.0:1789302751.581164:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:0.0:1789302751.581177:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+19:14476:x1876219484296320:12345-192.168.203.42@tcp:54:lfs.0 00010000:00010000:0.0:1789302751.581346:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581369:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581384:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581480:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581489:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581497:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581505:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302751.581510:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581520:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581534:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:0.0:1789302751.581538:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302751.581544:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302751.581551:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8e00/0x20be524657f12ad7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302751.581968:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+19:14476:x1876219484296320:12345-192.168.203.42@tcp:54:lfs.0 Request processed in 791us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302751.581986:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 32 00000100:00100000:2.0:1789302751.582551:0:16602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484296448 00000100:00100000:2.0:1789302751.582560:0:16602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484296448 00000100:00100000:2.0:1789302751.582615:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:2.0:1789302751.582625:0:16602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec38e548-5fa9-4016-a7ed-50e11bf82d59+19:2352:x1876219484296448:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302751.582651:0:16602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302751.582680:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12ac9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b45 expref: 19 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302751.582698:0:16602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302751.582702:0:16602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302751.582738:0:16602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec38e548-5fa9-4016-a7ed-50e11bf82d59+18:2352:x1876219484296448:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 115us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302751.582744:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:2.0:1789302751.588497:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.588823:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484296704 00000100:00100000:1.0:1789302751.588836:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484296704 00000100:00100000:1.0:1789302751.588912:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 7 00000100:00100000:1.0:1789302751.588924:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+18:14476:x1876219484296704:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:1.0:1789302751.589614:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+19:14476:x1876219484296704:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 688us (1128us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789302751.589624:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 7 00000001:00080000:0.0:1789302751.742677:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934601 is committed 00000001:00080000:0.0:1789302751.742697:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1789302751.742705:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:0.0:1789302751.742720:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:0.0:1789302751.758648:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789302751.932490:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.932702:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484296960 00000100:00100000:1.0:1789302751.932716:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484296960 00000100:00100000:1.0:1789302751.932791:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:1.0:1789302751.932802:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+11:14507:x1876219484296960:12345-192.168.203.42@tcp:101:cat.0 00010000:00010000:1.0:1789302751.932834:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302751.932858:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12ade lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b4c expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.932998:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12ae5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.933036:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.933051:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302751.933064:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789302751.933337:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045e00/0x20be524657f12ade lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b4c expref: 14 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.933358:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b4c expref: 13 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302751.933367:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302751.933370:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302751.933374:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044000, rc 0) 00000100:00100000:1.0:1789302751.933645:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+13:14507:x1876219484296960:12345-192.168.203.42@tcp:101:cat.0 Request processed in 842us (1165us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789302751.933653:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 33 00000100:00100000:1.0:1789302751.942444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302751.942553:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302751.942802:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484297344 00000100:00100000:3.0:1789302751.942816:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484297344 00000100:00100000:3.0:1789302751.942897:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:3.0:1789302751.942909:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+13:2352:x1876219484297344:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302751.942929:0:14472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302751.942980:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044000/0x20be524657f12ae5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b4c expref: 13 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302751.943002:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:3.0:1789302751.943007:0:14472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789302751.943075:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+12:2352:x1876219484297344:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 168us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302751.943082:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 1 00000100:00100000:2.0:1789302751.945144:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484297216 00000100:00100000:2.0:1789302751.945163:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484297216 00000100:00100000:2.0:1789302751.945261:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:2.0:1789302751.945271:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+12:14507:x1876219484297216:12345-192.168.203.42@tcp:35:cat.0 00000100:00100000:2.0:1789302751.945733:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+13:14507:x1876219484297216:12345-192.168.203.42@tcp:35:cat.0 Request processed in 461us (3300us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789302751.945742:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 8 00000100:00100000:1.0:1789302752.048389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302752.048633:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484297600 00000100:00100000:3.0:1789302752.048647:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484297600 00000100:00100000:3.0:1789302752.048819:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:3.0:1789302752.048832:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+13:14513:x1876219484297600:12345-192.168.203.42@tcp:101:dd.0 00010000:00010000:3.0:1789302752.048867:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302752.048904:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6e00/0x20be524657f12af3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b53 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.049237:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12afa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.049256:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12afa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.049341:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12afa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302752.049357:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789302752.049734:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6e00/0x20be524657f12af3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b53 expref: 16 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.049757:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12afa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b53 expref: 15 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.049767:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:3.0:1789302752.049770:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789302752.049774:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6600, rc 0) 00000100:00100000:3.0:1789302752.049908:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+15:14513:x1876219484297600:12345-192.168.203.42@tcp:101:dd.0 Request processed in 1079us (1533us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789302752.049916:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 34 00000100:00100000:3.0:1789302752.054408:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302752.054726:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484297856 00000100:00100000:2.0:1789302752.055478:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484297856 00000100:00100000:2.0:1789302752.055649:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 35 00000100:00100000:2.0:1789302752.055670:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+15:14513:x1876219484297856:12345-192.168.203.42@tcp:36:dd.0 00010000:00010000:2.0:1789302752.055754:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789302752.055789:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6600/0x20be524657f12afa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b53 expref: 15 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.055815:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045000/0x20be524657f12aad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b37 expref: 14 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.055826:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302752.055832:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302752.056499:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.056822:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.056838:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302752.057492:0:14486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789302752.057807:0:14486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004323d5a2 reply state 0000000014721414 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302752.057820:0:14486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302752.058559:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+16:14513:x1876219484297856:12345-192.168.203.42@tcp:36:dd.0 Request processed in 2884us (4159us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789302752.058572:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 35 00000020:00080000:2.0:1789302752.058579:0:14486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789302752.067433:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.067456:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.067464:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.067470:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302752.067476:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.067597:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.067620:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302752.067623:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302752.067629:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.067636:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b08 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302752.189559:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302752.189919:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484298112 00000100:00100000:2.0:1789302752.189950:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484298112 00000100:00100000:2.0:1789302752.190037:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 9 00000100:00100000:2.0:1789302752.190049:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a69362f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+15:14513:x1876219484298112:12345-192.168.203.42@tcp:35:dd.0 00000100:00100000:2.0:1789302752.190416:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a69362f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+16:14513:x1876219484298112:12345-192.168.203.42@tcp:35:dd.0 Request processed in 368us (871us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1789302752.190425:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 9 00010000:00010000:3.0:1789302752.205517:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789302752.468230:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302752.468331:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484298240 00000100:00100000:3.0:1789302752.468345:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484298240 00000100:00100000:3.0:1789302752.468572:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:3.0:1789302752.468586:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+16:14527:x1876219484298240:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:3.0:1789302752.468621:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302752.468650:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6e00/0x20be524657f12b0f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b5a expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.468762:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.468780:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.468793:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.468809:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.468816:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302752.468822:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473523:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473553:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473568:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302752.473625:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789302752.473630:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302752.473687:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473702:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473712:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473719:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473727:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473750:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302752.473754:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473762:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473778:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:2.0:1789302752.473781:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302752.473787:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473793:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7c00/0x20be524657f12b16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473808:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473814:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473819:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473824:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba6c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302752.473826:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473831:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473848:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6904039600) 00010000:00010000:2.0:1789302752.473851:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302752.473855:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.473860:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12b1d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.475540:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6e00/0x20be524657f12b0f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b5a expref: 18 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.475567:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b5a expref: 17 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.475575:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302752.475578:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302752.475582:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9e00, rc 0) 00000100:00100000:2.0:1789302752.475683:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+17:14527:x1876219484298240:12345-192.168.203.42@tcp:101:stat.0 Request processed in 7099us (7466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302752.475692:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 36 00000100:00100000:3.0:1789302752.605482:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302752.605727:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484298496 00000100:00100000:2.0:1789302752.605741:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484298496 00000100:00100000:2.0:1789302752.605822:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 37 00000100:00100000:2.0:1789302752.605834:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+17:14533:x1876219484298496:12345-192.168.203.42@tcp:36:truncate.0 00010000:00010000:2.0:1789302752.605909:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302752.605957:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b5a expref: 17 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.606384:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302752.606393:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789302752.606807:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.606827:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.606840:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302752.606902:0:14486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1789302752.606932:0:14486:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099599f81 reply state 00000000c892acac transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302752.606956:0:14486:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302752.607244:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+19:14533:x1876219484298496:12345-192.168.203.42@tcp:36:truncate.0 Request processed in 1407us (1772us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789302752.607253:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 37 00000020:00080000:2.0:1789302752.607260:0:14486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789302752.614198:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302752.614221:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302752.614230:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302752.614255:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302752.614261:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302752.614270:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302752.614322:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302752.614326:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302752.614333:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302752.614340:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12b2b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302752.653805:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789302752.653835:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505253120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789302752.653936:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302752.654001:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505253120 00000100:00100000:1.0:1789302752.654021:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505253120 00000100:00100000:1.0:1789302752.654105:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789302752.654119:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505253120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302752.654171:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302752.654241:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505253120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302752.654249:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789302752.655536:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505253120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302752.788377:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302752.797190:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484298624 00000100:00100000:2.0:1789302752.797216:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484298624 00000100:00100000:2.0:1789302752.797339:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:2.0:1789302752.797355:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+18:14547:x1876219484298624:12345-192.168.203.42@tcp:101:stat.0 00010000:00010000:2.0:1789302752.797388:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302752.797438:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b32 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b61 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.797538:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.797557:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.797572:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.797588:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.797596:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.797603:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.797982:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.797994:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798001:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302752.798058:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789302752.798064:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789302752.798087:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798109:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798118:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798125:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798132:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798139:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302752.798144:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798152:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798166:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:2.0:1789302752.798170:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302752.798175:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798182:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798198:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798204:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798217:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798222:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302752.798225:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798231:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798240:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6907c68c00) 00010000:00010000:2.0:1789302752.798243:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302752.798245:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798251:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798349:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12b32 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 20 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798367:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 19 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302752.798374:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302752.798376:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302752.798379:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8000, rc 0) 00000100:00100000:2.0:1789302752.798479:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+19:14547:x1876219484298624:12345-192.168.203.42@tcp:101:stat.0 Request processed in 1127us (10115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302752.798500:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 38 00000100:00100000:3.0:1789302752.908416:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302752.908605:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484298880 00000100:00100000:1.0:1789302752.908623:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484298880 00000100:00100000:1.0:1789302752.908714:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:1.0:1789302752.908726:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68053d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+19:14557:x1876219484298880:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:1.0:1789302752.908754:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302752.908798:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f12b4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b68 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302752.908923:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789302752.909113:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f12b4e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b68 expref: 21 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302752.909130:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:1.0:1789302752.909134:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789302752.909140:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f12b4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b68 expref: 21 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302752.909158:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044e00, rc 0) 00000100:00100000:1.0:1789302752.909245:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68053d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+20:14557:x1876219484298880:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 520us (845us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1789302752.909253:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 39 00000100:00100000:0.0:1789302752.919134:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302752.919242:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484299136 00000100:00100000:2.0:1789302752.919257:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484299136 00000100:00100000:2.0:1789302752.919356:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:2.0:1789302752.919368:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a690b98c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+20:14557:x1876219484299136:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:2.0:1789302752.919707:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a690b98c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+21:14557:x1876219484299136:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 340us (587us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789302752.919715:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 10 00000100:00100000:0.0:1789302753.011499:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.011585:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484299392 00000100:00100000:1.0:1789302753.011602:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484299392 00000100:00100000:1.0:1789302753.011703:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00080000:2.0:1789302753.011711:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302753.011719:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+21:14563:x1876219484299392:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302753.011869:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302753.011899:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f12b5c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b6f expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.012086:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.012167:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.012186:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.012197:0:14486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.012240:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.012256:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 22 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302753.012272:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c395c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14486:1876219505253248:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302753.012693:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.012704:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 22 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302753.012714:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14486:1876219505253376:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302753.012742:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69367190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789302753.017325:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c395c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14486:1876219505253248:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302753.017345:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c397800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14486:1876219505253376:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302753.017448:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302753.020053:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302753.020108:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.020232:0:14471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484299520 00000100:00100000:2.0:1789302753.020233:0:16602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484299648 00000100:00100000:2.0:1789302753.020246:0:16602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484299648 00000100:00100000:1.0:1789302753.020246:0:14471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484299520 00010000:00010000:1.0:1789302753.020328:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 24 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.020415:0:16602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 24 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302753.020432:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789302753.020450:0:14471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680501fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:2352:x1876219484299520:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789302753.020475:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302753.020485:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 24 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.020501:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 24 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.020530:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b61 expref: 24 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.020550:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302753.020555:0:14471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.020567:0:14471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.021027:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302753.021263:0:14471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680501fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:2352:x1876219484299520:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 813us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302753.021332:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:2.0:1789302753.021683:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:2.0:1789302753.021697:0:16602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec38e548-5fa9-4016-a7ed-50e11bf82d59+22:2352:x1876219484299648:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302753.021712:0:16602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302753.021721:0:16602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 22 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.021748:0:16602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 22 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.021767:0:16602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044600/0x20be524657f12a98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b30 expref: 22 pid: 14484 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.021795:0:16602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302753.021800:0:16602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.021809:0:16602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.021817:0:16602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.021849:0:16602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789302753.021867:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.021876:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302753.021882:0:16602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec38e548-5fa9-4016-a7ed-50e11bf82d59+21:2352:x1876219484299648:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 190us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302753.021889:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000004:00200000:3.0:1789302753.021902:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1789302753.022333:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044e00/0x20be524657f12b5c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 22 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.022352:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 21 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.022360:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:3.0:1789302753.022363:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789302753.022365:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044a00, rc 0) 00000100:00100000:3.0:1789302753.022404:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+21:14563:x1876219484299392:12345-192.168.203.42@tcp:101:bash.0 Request processed in 10693us (10921us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1789302753.022413:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 40 00000100:00100000:0.0:1789302753.026070:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.026164:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484299904 00000100:00100000:2.0:1789302753.026178:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484299904 00000100:00100000:2.0:1789302753.026260:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 41 00000100:00100000:2.0:1789302753.026272:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+21:14563:x1876219484299904:12345-192.168.203.42@tcp:36:bash.0 00010000:00010000:2.0:1789302753.026743:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.026766:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.026779:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789302753.026841:0:14484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1789302753.026869:0:14484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e10d512 reply state 000000000dba883d transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302753.026898:0:14484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789302753.027128:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14563:x1876219484299904:12345-192.168.203.42@tcp:36:bash.0 Request processed in 858us (1074us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789302753.027137:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 41 00000020:00080000:2.0:1789302753.027143:0:14484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789302753.029207:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.029227:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.029237:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.029243:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302753.029249:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.029258:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.029277:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302753.029281:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302753.029307:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.029315:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12b71 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302753.030119:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.030186:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484300032 00000100:00100000:2.0:1789302753.030216:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484300032 00000100:00100000:2.0:1789302753.030319:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:2.0:1789302753.030332:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14563:x1876219484300032:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302753.030363:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302753.030386:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b76 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.030461:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b76 expref: 24 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.030477:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b78 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b76 expref: 24 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.030499:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302753.030502:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302753.030506:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9a00, rc 0) 00000100:00100000:2.0:1789302753.030581:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14563:x1876219484300032:12345-192.168.203.42@tcp:101:bash.0 Request processed in 252us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302753.030739:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 42 00000100:00100000:0.0:1789302753.037481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.037656:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484300160 00000100:00100000:2.0:1789302753.037670:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484300160 00000100:00100000:2.0:1789302753.037749:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:2.0:1789302753.037762:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14563:x1876219484300160:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:2.0:1789302753.037790:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302753.037823:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12b7f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b7d expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.037933:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.038020:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 25 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.038031:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.038077:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 25 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.038090:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 25 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302753.038107:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c372680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14484:1876219505253504:192.168.203.42@tcp:104: 00000100:00100000:2.0:1789302753.038209:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690492f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302753.040729:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.040924:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c372680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14484:1876219505253504:192.168.203.42@tcp:104: 00010000:00010000:2.0:1789302753.040959:0:14484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302753.040960:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484300288 00000100:00100000:3.0:1789302753.040978:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484300288 00010000:00010000:3.0:1789302753.041145:0:14472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 26 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302753.041417:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:3.0:1789302753.041428:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+26:2351:x1876219484300288:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302753.041447:0:14472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302753.041455:0:14472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 26 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.041469:0:14472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 26 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.041564:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12b63 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b6f expref: 26 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.041605:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:3.0:1789302753.041611:0:14472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.041621:0:14472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.041630:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.041666:0:14472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302753.041715:0:14484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.041723:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302753.041730:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+25:2351:x1876219484300288:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 304us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302753.041736:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000004:00200000:1.0:1789302753.042226:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789302753.042233:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302753.042261:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.042325:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12b7f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b7d expref: 25 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.042344:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b7d expref: 24 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.042353:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302753.042356:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789302753.042359:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f8000, rc 0) 00000100:00100000:1.0:1789302753.042404:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14563:x1876219484300160:12345-192.168.203.42@tcp:101:bash.0 Request processed in 4645us (4938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302753.042413:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 43 00000100:00100000:0.0:1789302753.047668:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.047759:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484300544 00000100:00100000:1.0:1789302753.047774:0:14473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484300544 00000100:00100000:1.0:1789302753.047862:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:1.0:1789302753.047885:0:14473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14563:x1876219484300544:12345-192.168.203.42@tcp:103:bash.0 00010000:00010000:1.0:1789302753.047925:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789302753.047958:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8000/0x20be524657f12b86 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b7d expref: 24 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.047995:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9a00/0x20be524657f12b78 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b76 expref: 23 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.048016:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302753.048031:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789302753.048233:0:14473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+22:14563:x1876219484300544:12345-192.168.203.42@tcp:103:bash.0 Request processed in 360us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302753.048242:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 2 00000100:00100000:0.0:1789302753.051927:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302753.052069:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484300672 00000100:00100000:3.0:1789302753.052083:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484300672 00000100:00100000:3.0:1789302753.052165:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:3.0:1789302753.052178:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+22:14563:x1876219484300672:12345-192.168.203.42@tcp:58:bash.0 00010000:00010000:3.0:1789302753.052342:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.052363:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.052377:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789302753.053796:0:14485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789302753.054010:0:14485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789302753.054105:0:14485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789302753.054264:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+22:14563:x1876219484300672:12345-192.168.203.42@tcp:58:bash.0 Request processed in 2082us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302753.054276:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 44 00000100:00100000:2.0:1789302753.056386:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.056432:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484300800 00000100:00100000:1.0:1789302753.056446:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484300800 00000100:00100000:1.0:1789302753.056581:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 45 00000100:00100000:1.0:1789302753.056604:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+22:14563:x1876219484300800:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302753.056630:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302753.056659:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12b94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b84 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.056727:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.056738:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12b94 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b84 expref: 23 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.056754:0:14484:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.056782:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12b94 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b84 expref: 23 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.056795:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6904039f00) 00010000:00010000:1.0:1789302753.056798:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302753.056801:0:14484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12b94 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b84 expref: 23 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.056806:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045600, rc 0) 00000100:00100000:1.0:1789302753.056860:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14563:x1876219484300800:12345-192.168.203.42@tcp:101:bash.0 Request processed in 260us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302753.056866:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 45 00010000:00010000:3.0:1789302753.230148:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789302753.805643:0:14518:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789302753.805657:0:14518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789302753.805742:0:14518:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789302753.805751:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789302753.805927:0:14518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c373b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14518:1876219505253632:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789302753.806079:0:14518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690492f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789302753.816777:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302753.818666:0:14518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c373b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14518:1876219505253632:192.168.203.42@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789302753.819744:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484300928 00000100:00100000:1.0:1789302753.819759:0:14495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484300928 00000100:00100000:1.0:1789302753.819842:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:1.0:1789302753.819855:0:14495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14565:x1876219484300928:12345-192.168.203.42@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789302753.820003:0:14495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14565:x1876219484300928:12345-192.168.203.42@tcp:900:lhsmtool_posix.0 Request processed in 151us (3241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302753.820012:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00100000:3.0:1789302753.823189:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.825679:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484301056 00000100:00100000:2.0:1789302753.825938:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484301056 00000100:00100000:2.0:1789302753.826187:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:2.0:1789302753.826201:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14565:x1876219484301056:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789302753.826483:0:14485:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789302753.827056:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14565:x1876219484301056:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 855us (4024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302753.827066:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 46 00000100:00100000:0.0:1789302753.840684:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.840920:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484301184 00000100:00100000:1.0:1789302753.840935:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484301184 00000100:00100000:1.0:1789302753.841025:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:1.0:1789302753.841051:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14565:x1876219484301184:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789302753.841145:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.841187:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.841203:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842179:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842201:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842214:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842244:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842253:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842259:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789302753.842328:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789302753.842334:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789302753.842349:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842362:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842385:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842392:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842398:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044c00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302753.842402:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842410:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842421:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69051afb00) 00010000:00010000:1.0:1789302753.842424:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302753.842428:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842433:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044c00/0x20be524657f12b9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842447:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842453:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842459:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842472:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302753.842479:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842486:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842494:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a69051af900) 00010000:00010000:1.0:1789302753.842496:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302753.842499:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842505:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12ba2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842518:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842523:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842529:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842534:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302753.842537:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842543:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842548:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6904039f00) 00010000:00010000:1.0:1789302753.842550:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302753.842557:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.842564:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12ba9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302753.842653:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14565:x1876219484301184:12345-192.168.203.42@tcp:34:lhsmtool_posix.0 Request processed in 1602us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302753.842662:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 47 00000100:00100000:0.0:1789302753.847168:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.847239:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484301440 00000100:00100000:2.0:1789302753.847255:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484301440 00000100:00100000:2.0:1789302753.847378:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:2.0:1789302753.847391:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14565:x1876219484301440:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302753.847419:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302753.847446:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12bb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b8b expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847577:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847594:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847609:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789302753.847648:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789302753.847781:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847790:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847798:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847804:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9000 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302753.847809:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847818:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847833:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6904039f00) 00010000:00010000:2.0:1789302753.847837:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789302753.847844:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847850:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847907:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12bb0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b8b expref: 25 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847919:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a69051afb00) 00010000:00010000:2.0:1789302753.847921:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789302753.847932:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12bb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b8b expref: 25 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.847944:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9e00, rc 0) 00000100:00100000:2.0:1789302753.848035:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14565:x1876219484301440:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 645us (882us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1789302753.848044:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 48 00000100:00100000:3.0:1789302753.853267:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.855270:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484301568 00000100:00100000:1.0:1789302753.855321:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484301568 00000100:00100000:1.0:1789302753.855424:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:1.0:1789302753.855438:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14565:x1876219484301568:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789302753.855488:0:14484:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789302753.855623:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14565:x1876219484301568:12345-192.168.203.42@tcp:53:lhsmtool_posix.0 Request processed in 188us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302753.855639:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 49 00000100:00100000:0.0:1789302753.860739:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.860877:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484301824 00000100:00100000:2.0:1789302753.860890:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484301824 00000100:00100000:2.0:1789302753.860978:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:2.0:1789302753.860990:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14565:x1876219484301824:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302753.861019:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302753.861056:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12bc5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b92 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789302753.862055:0:14485:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1789302753.862065:0:14485:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789302753.862116:0:14485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789302753.862480:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bcc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.862501:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.862516:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.862593:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9e00/0x20be524657f12bc5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b92 expref: 27 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.862628:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b92 expref: 26 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.862638:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6907c68c00) 00010000:00010000:2.0:1789302753.862641:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789302753.862645:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9000, rc 0) 00000100:00100000:2.0:1789302753.862734:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+26:14565:x1876219484301824:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 1744us (2010us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789302753.862743:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 50 00000100:00100000:0.0:1789302753.872492:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.872600:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484302080 00000100:00100000:1.0:1789302753.872615:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484302080 00000100:00100000:1.0:1789302753.872700:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:1.0:1789302753.872715:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+26:14565:x1876219484302080:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302753.872798:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789302753.872837:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9000/0x20be524657f12bcc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b92 expref: 26 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.872863:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6907c68c00) 00010000:00010000:1.0:1789302753.872877:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789302753.872908:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.872942:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.872955:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873162:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873186:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873200:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873644:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873653:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873661:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873667:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302753.873671:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873679:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873693:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:1.0:1789302753.873703:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302753.873709:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873716:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bda lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873730:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873736:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.873742:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.878459:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302753.878475:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.878490:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.878508:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa509ea76 (ffff9a69051af900) 00010000:00010000:1.0:1789302753.878512:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789302753.878517:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.878525:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa509ea76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302753.878644:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+25:14565:x1876219484302080:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 5928us (6162us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789302753.878667:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 51 00000100:00100000:3.0:1789302753.884805:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.884877:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484302208 00000100:00100000:1.0:1789302753.884893:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484302208 00000100:00100000:1.0:1789302753.884987:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:1.0:1789302753.884998:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+25:14565:x1876219484302208:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302753.885018:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302753.885049:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3b99 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.885085:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.885100:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.885112:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.885230:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12be8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b99 expref: 27 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.885248:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044a00/0x20be524657f12bef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b99 expref: 26 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.885256:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302753.885259:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789302753.885263:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942044a00, rc 0) 00000100:00100000:1.0:1789302753.885412:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+26:14565:x1876219484302208:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 410us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302753.885427:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 52 00000100:00100000:0.0:1789302753.902243:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302753.902348:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484302464 00000100:00100000:1.0:1789302753.902364:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484302464 00000100:00100000:1.0:1789302753.902438:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 53 00000100:00100000:1.0:1789302753.902451:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+26:14565:x1876219484302464:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789302753.902528:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.902545:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302753.902557:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789302753.906425:0:14484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789302753.906459:0:14484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465092172248ns, next at 466092165823ns, rc = 0 00000004:00010000:0.0:1789302753.906753:0:14484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1727df5 reply state 00000000913eba81 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302753.906768:0:14484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302753.907257:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+28:14565:x1876219484302464:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 4802us (5021us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1789302753.907269:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 53 00010000:00010000:0.0:1789302753.911630:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302753.911654:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302753.911663:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302753.911669:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:0.0:1789302753.911675:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302753.911683:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302753.911704:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:0.0:1789302753.911707:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789302753.911713:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302753.911720:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942044400/0x20be524657f12bf6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302753.917760:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.918117:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484302592 00000100:00100000:2.0:1789302753.918131:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484302592 00000100:00100000:2.0:1789302753.918210:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:2.0:1789302753.918222:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+27:14565:x1876219484302592:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302753.918252:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302753.918312:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3ba0 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.918388:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 28 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.918403:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 28 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.918424:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302753.918428:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789302753.918448:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9200, rc 0) 00000100:00100000:2.0:1789302753.918511:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+28:14565:x1876219484302592:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 292us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302753.918519:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 54 00000100:00100000:2.0:1789302753.922901:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302753.922997:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484302720 00000100:00100000:0.0:1789302753.923011:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484302720 00000100:00100000:0.0:1789302753.923113:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:0.0:1789302753.923128:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2351:x1876219484302720:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789302753.923645:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c370a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2351:x1876219484302720:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 519us (756us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789302753.923654:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00080000:2.0:1789302753.923779:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789302753.927625:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.927812:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484302976 00000100:00100000:2.0:1789302753.927826:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484302976 00000100:00100000:2.0:1789302753.927900:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:2.0:1789302753.927911:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+28:14565:x1876219484302976:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789302753.928254:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+29:14565:x1876219484302976:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 344us (648us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789302753.928272:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 11 00000100:00100000:1.0:1789302753.931521:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302753.931645:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484303232 00000100:00100000:0.0:1789302753.931658:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484303232 00000100:00100000:0.0:1789302753.931732:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:0.0:1789302753.931744:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+29:14565:x1876219484303232:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789302753.931897:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+29:14565:x1876219484303232:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 154us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302753.931906:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 55 00000100:00100000:0.0:1789302753.937802:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302753.938195:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484303360 00000100:00100000:3.0:1789302753.938209:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484303360 00000100:00100000:3.0:1789302753.938362:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:3.0:1789302753.938383:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+29:14565:x1876219484303360:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789302753.938418:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789302753.938447:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6e00/0x20be524657f12c04 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3ba7 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.938559:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12c0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.938577:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12c0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.938589:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12c0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789302753.938650:0:14485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789302753.938679:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12c0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.938710:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6e00/0x20be524657f12c04 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba7 expref: 31 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.938731:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12c0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba7 expref: 30 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302753.938742:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:3.0:1789302753.938763:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789302753.938768:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a692aba6c00, rc 0) 00000100:00100000:3.0:1789302753.938840:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+30:14565:x1876219484303360:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 468us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302753.938848:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 56 00000100:00100000:0.0:1789302753.943393:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.943607:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484303488 00000100:00100000:2.0:1789302753.943621:0:15170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484303488 00000100:00100000:2.0:1789302753.943696:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:2.0:1789302753.943708:0:15170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2352:x1876219484303488:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789302753.943734:0:15170:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789302753.943763:0:15170:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3bae expref: -99 pid: 15170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789302753.943800:0:15170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa697e0, blocks: 0x1 00010000:00010000:2.0:1789302753.943827:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1789302753.943833:0:15170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789302753.943844:0:15170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 7 pid: 15170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.943893:0:15170:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 7 pid: 15170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302753.943908:0:15170:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a69033f9600, rc 0) 00000100:00100000:2.0:1789302753.943986:0:15170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:2352:x1876219484303488:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 281us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302753.943994:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:1.0:1789302753.948659:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302753.949208:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484303744 00000100:00100000:2.0:1789302753.949222:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484303744 00000100:00100000:2.0:1789302753.949344:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:2.0:1789302753.949357:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+30:14565:x1876219484303744:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789302753.949503:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+30:14565:x1876219484303744:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 148us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302753.949512:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 57 00000100:00100000:0.0:1789302753.952995:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302753.953222:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484303872 00000100:00100000:3.0:1789302753.953235:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484303872 00000100:00100000:3.0:1789302753.953773:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:3.0:1789302753.953789:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+30:14565:x1876219484303872:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789302754.051101:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:2.0:1789302754.051118:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789302754.051319:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:3.0:1789302754.051514:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505253760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789302754.051623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302754.051860:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+13:14565:x1876219484303872:12345-192.168.203.42@tcp:44:lhsmtool_posix.0 Request processed in 98056us (98860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302754.051871:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 58 00000100:00100000:2.0:1789302754.054246:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505253760 00000100:00100000:2.0:1789302754.054268:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505253760 00000100:00100000:2.0:1789302754.054385:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789302754.054397:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6806192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505253760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789302754.054941:0:15168:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789302754.054946:0:15168:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789302754.054949:0:15168:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789302754.054980:0:15168:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789302752 -> 1789302752 00002000:00010000:2.0:1789302754.054983:0:15168:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789302754.055075:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6806192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876219505253760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 681us (3462us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789302754.055084:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789302754.055283:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789302754.055809:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a693c370e00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789302754.055819:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505253760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789302754.056793:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302754.056909:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484304000 00000100:00100000:1.0:1789302754.056918:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484304000 00000100:00100000:1.0:1789302754.056991:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:1.0:1789302754.057012:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:2351:x1876219484304000:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789302754.057144:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:2351:x1876219484304000:12345-192.168.203.42@tcp:16:lhsmtool_posix.0 Request processed in 143us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302754.057151:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:1.0:1789302754.063838:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.064204:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484304256 00000100:00100000:0.0:1789302754.064218:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484304256 00000100:00100000:0.0:1789302754.064379:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:0.0:1789302754.064392:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+13:14565:x1876219484304256:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789302754.064494:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302754.064528:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba6c00/0x20be524657f12c0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba7 expref: 13 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.064563:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:0.0:1789302754.064569:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789302754.064610:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.064636:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.064646:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789302754.064893:0:14484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2eb7fd2 reply state 000000005f97dc26 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302754.064903:0:14484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789302754.065056:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+14:14565:x1876219484304256:12345-192.168.203.42@tcp:36:lhsmtool_posix.0 Request processed in 666us (1233us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1789302754.065064:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 59 00000100:00100000:1.0:1789302754.069075:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302754.069120:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484304384 00000100:00100000:1.0:1789302754.069133:0:15168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484304384 00000100:00100000:1.0:1789302754.069209:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:1.0:1789302754.069222:0:15168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:14565:x1876219484304384:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789302754.069247:0:15168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302754.069271:0:15168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3bb5 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.069348:0:15168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 8 pid: 15170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.069358:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302754.069363:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302754.069369:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 8 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.069722:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.069732:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.069740:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.069746:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:3.0:1789302754.069752:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.069769:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.069789:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:3.0:1789302754.069793:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789302754.069799:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.069806:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9a00/0x20be524657f12c19 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.069879:0:15168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 8 pid: 15170 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.069897:0:15168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 8 pid: 15170 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302754.069913:0:15168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15168:1876219505253888:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302754.070034:0:15168:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6936719240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302754.075079:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302754.075138:0:16602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484304512 00000100:00100000:3.0:1789302754.075150:0:16602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484304512 00010000:00010000:3.0:1789302754.075208:0:16602:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 9 pid: 15170 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789302754.075255:0:16602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:3.0:1789302754.075266:0:16602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:2352:x1876219484304512:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789302754.075303:0:16602:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789302754.075337:0:16602:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 9 pid: 15170 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.075354:0:16602:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 9 pid: 15170 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.075388:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302754.075675:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb5b3711/0x20be524657f12c12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bae expref: 9 pid: 15170 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302754.075693:0:15168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15168:1876219505253888:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302754.075824:0:16602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789302754.075832:0:16602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 8 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.075844:0:16602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 8 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.077040:0:15168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 8 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.077065:0:15168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045e00, rc 0) 00000100:00100000:1.0:1789302754.077845:0:15168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:14565:x1876219484304384:12345-192.168.203.42@tcp:101:lhsmtool_posix.0 Request processed in 8622us (8780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302754.077868:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00010000:00010000:2.0:1789302754.080190:0:16602:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 7 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302754.080227:0:16602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c372a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16602:1876219505254016:192.168.203.42@tcp:105: 00000100:00100000:2.0:1789302754.081009:0:16602:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6908dcc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302754.084429:0:16602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c372a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16602:1876219505254016:192.168.203.42@tcp:105: 00010000:00010000:0.0:1789302754.084469:0:16602:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302754.084563:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302754.084619:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484304640 00000100:00100000:1.0:1789302754.084629:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484304640 00000100:00100000:1.0:1789302754.084696:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:1.0:1789302754.084708:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:2352:x1876219484304640:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789302754.084991:0:15169:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789302754.084995:0:15169:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789302752 00002000:00010000:1.0:1789302754.084998:0:15169:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789302750 00002000:00010000:1.0:1789302754.085010:0:15169:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789302752 -> 1789302752 00002000:00010000:1.0:1789302754.085013:0:15169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789302754.085374:0:16602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807257b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:2352:x1876219484304512:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 10106us (10307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302754.085385:0:16602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:1.0:1789302754.087131:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:2352:x1876219484304640:12345-192.168.203.42@tcp:2:lhsmtool_posix.0 Request processed in 2412us (2834us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789302754.087146:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 17 00000100:00100000:2.0:1789302754.095608:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302754.095753:0:15728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484304768 00000100:00100000:1.0:1789302754.095768:0:15728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484304768 00000100:00100000:1.0:1789302754.095938:0:15728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:1.0:1789302754.095951:0:15728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:2351:x1876219484304768:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789302754.096042:0:15728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.096092:0:15728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 8 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.096101:0:15728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302754.096105:0:15728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789302754.096110:0:15728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.096155:0:15728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 8 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.096171:0:15728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 8 pid: 15168 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302754.096188:0:15728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15728:1876219505254144:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302754.096323:0:15728:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6936719240 going to sleep for 11 seconds 00000100:00100000:1.0:1789302754.100171:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302754.100392:0:15728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c396a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15728:1876219505254144:192.168.203.42@tcp:104: 00010000:00010000:3.0:1789302754.100438:0:15728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302754.100619:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484304896 00000100:00100000:0.0:1789302754.100645:0:14473:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484304896 00010000:00010000:0.0:1789302754.100684:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 9 pid: 15168 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302754.100712:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:0.0:1789302754.100719:0:14473:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+9:2352:x1876219484304896:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789302754.100734:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789302754.100758:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 9 pid: 15168 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.100768:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 9 pid: 15168 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.100791:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062c38e99/0x20be524657f12c20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bb5 expref: 9 pid: 15168 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.100808:0:14473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302754.100811:0:14473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789302754.100816:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.100823:0:14473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.100850:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789302754.100951:0:14473:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:2352:x1876219484304896:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 231us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302754.100975:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00010000:00010000:3.0:1789302754.101149:0:15728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.101159:0:15728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.101192:0:15728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.101201:0:15728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.101211:0:15728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.101230:0:15728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942044000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:3.0:1789302754.101233:0:15728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.101241:0:15728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.101253:0:15728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.101260:0:15728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6aaad11/0x20be524657f12c27 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789302754.102765:0:15728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:2351:x1876219484304768:12345-192.168.203.42@tcp:1:lhsmtool_posix.0 Request processed in 6801us (7229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302754.102779:0:15728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:1.0:1789302754.106155:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.106338:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484305152 00000100:00100000:0.0:1789302754.106352:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484305152 00000100:00100000:1.0:1789302754.106478:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 60 00000100:00100000:1.0:1789302754.106491:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+13:14565:x1876219484305152:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789302754.106599:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.106620:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.106649:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.106935:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.106947:0:14485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 14 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.106956:0:14485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.107007:0:14485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 14 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.107023:0:14485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 14 pid: 14486 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302754.107041:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876219505254272:192.168.203.42@tcp:104: 00000100:00100000:1.0:1789302754.107146:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6936719240 going to sleep for 11 seconds 00000100:00100000:3.0:1789302754.113706:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302754.113785:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484305280 00000100:00100000:1.0:1789302754.113884:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876219505254272:192.168.203.42@tcp:104: 00010000:00010000:1.0:1789302754.113921:0:14485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302754.113983:0:14472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484305280 00010000:00010000:2.0:1789302754.114046:0:14472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 15 pid: 14486 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302754.114096:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 16 00000100:00100000:2.0:1789302754.114108:0:14472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+15:2351:x1876219484305280:12345-192.168.203.42@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789302754.114128:0:14472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789302754.114136:0:14472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 15 pid: 14486 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.114159:0:14472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 15 pid: 14486 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.114188:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12bfd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3ba0 expref: 15 pid: 14486 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.114226:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302754.114232:0:14472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.114243:0:14472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.114252:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.114310:0:14472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789302754.114477:0:14472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+14:2351:x1876219484305280:12345-192.168.203.42@tcp:103:ldlm_bl.0 Request processed in 369us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302754.114486:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 16 00010000:00010000:3.0:1789302754.115891:0:14485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789302754.115907:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789302754.116190:0:14485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1789302754.117518:0:14485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789302754.117726:0:14485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789302754.117852:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14485:1876219505254400:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789302754.120097:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302754.120221:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a69029cd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789302754.120276:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505254400 00000100:00100000:2.0:1789302754.120310:0:14489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505254400 00000100:00100000:2.0:1789302754.120353:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789302754.120361:0:14489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14485:x1876219505254400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789302754.120459:0:14489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14485:x1876219505254400:12345-0@lo:1000:mdt00_001.0 Request processed in 98us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302754.120466:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789302754.120556:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14485:1876219505254400:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789302754.122193:0:14485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1789302754.122478:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14485:1876219505254528:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789302754.122650:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302754.122688:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a690cd1b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789302754.124330:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505254528 00000100:00100000:2.0:1789302754.124346:0:14489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505254528 00000100:00100000:2.0:1789302754.124409:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789302754.124420:0:14489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14485:x1876219505254528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789302754.124732:0:14489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14485:x1876219505254528:12345-0@lo:1000:mdt00_001.0 Request processed in 311us (2080us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789302754.124758:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789302754.125187:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c50d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14485:1876219505254528:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789302754.125251:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.125263:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126090:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126268:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045a00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302754.126274:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126298:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126319:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:1.0:1789302754.126324:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302754.126330:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126337:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045a00/0x20be524657f12c35 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126399:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126678:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126707:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126712:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a692aba7e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:1.0:1789302754.126715:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126723:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126733:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6904039f00) 00010000:00010000:1.0:1789302754.126736:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789302754.126745:0:14485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12b94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b84 expref: 17 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126757:0:14485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12b94 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b84 expref: 17 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.126768:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12b94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b84 expref: 17 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.127141:0:14485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045600/0x20be524657f12b94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3b84 expref: 17 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789302754.127162:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693beaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876219505254656:192.168.203.42@tcp:105: 00000100:00100000:1.0:1789302754.127655:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a693604d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789302754.136451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302754.136519:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484305408 00000100:00100000:3.0:1789302754.136552:0:14487:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484305408 00000100:00100000:3.0:1789302754.136624:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:3.0:1789302754.136635:0:14487:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+18:14563:x1876219484305408:12345-192.168.203.42@tcp:49:bash.0 00000100:00100000:3.0:1789302754.136777:0:14487:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+18:14563:x1876219484305408:12345-192.168.203.42@tcp:49:bash.0 Request processed in 144us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302754.136785:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 12 00000100:00100000:2.0:1789302754.137057:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693beaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14485:1876219505254656:192.168.203.42@tcp:105: 00010000:00010000:2.0:1789302754.137084:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137107:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a692aba7e00/0x20be524657f12b8d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137157:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137171:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137183:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137192:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137199:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137205:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137212:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302754.137216:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137222:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137244:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6904039f00) 00010000:00010000:2.0:1789302754.137247:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302754.137252:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137258:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c3c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137268:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137275:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137281:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137312:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6942045200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302754.137315:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137321:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137329:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6904039f00) 00010000:00010000:2.0:1789302754.137331:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789302754.137334:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.137340:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6942045200/0x20be524657f12c2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302754.137560:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+17:14565:x1876219484305152:12345-192.168.203.42@tcp:57:lhsmtool_posix.0 Request processed in 31072us (31426us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789302754.137570:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 60 00000020:00080000:2.0:1789302754.137575:0:14485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789302754.139480:0:14518:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789302754.139492:0:14518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789302754.139532:0:14518:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789302754.139545:0:14518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789302754.145676:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302754.145758:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484305536 00000100:00100000:1.0:1789302754.145768:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484305536 00000100:00100000:1.0:1789302754.145839:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:1.0:1789302754.145850:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:14563:x1876219484305536:12345-192.168.203.42@tcp:101:bash.0 00010000:00010000:1.0:1789302754.145868:0:15169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789302754.145889:0:15169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f12c43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3bbc expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789302754.145915:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa697e0, atime: 0x6aa697de, ctime: 0x6aa697e0, blocks: 0x1 00010000:00010000:1.0:1789302754.145936:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789302754.145941:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789302754.145951:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f12c43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bbc expref: 8 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.145978:0:15169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0aff05f/0x20be524657f12c43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bbc expref: 8 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789302754.145990:0:15169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6942045000, rc 0) 00000100:00100000:1.0:1789302754.146048:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:14563:x1876219484305536:12345-192.168.203.42@tcp:101:bash.0 Request processed in 200us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302754.146055:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:3.0:1789302754.149480:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302754.151064:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.159031:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484305792 00000100:00100000:0.0:1789302754.159046:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484305792 00000100:00100000:0.0:1789302754.159101:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484306048 00000100:00100000:0.0:1789302754.159104:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484306048 00000100:00100000:0.0:1789302754.159124:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 13 00000100:00100000:0.0:1789302754.159135:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+18:14563:x1876219484305792:12345-192.168.203.42@tcp:35:bash.0 00000001:00080000:0.0:1789302754.159436:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000001:00080000:0.0:1789302754.159556:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:0.0:1789302754.159673:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+21:14563:x1876219484305792:12345-192.168.203.42@tcp:35:bash.0 Request processed in 539us (10202us total) trans 8589934631 rc 0/0 00000100:00100000:0.0:1789302754.159681:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 13 00000020:00080000:0.0:1789302754.159687:0:14488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789302754.159706:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 14 00000100:00100000:0.0:1789302754.159714:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693c372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+20:14565:x1876219484306048:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789302754.160270:0:14488:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789302754.160412:0:14488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:0.0:1789302754.160457:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.160474:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.160487:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.160496:0:14488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.160502:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.160507:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.160529:0:14488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789302754.160582:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693c372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+22:14565:x1876219484306048:12345-192.168.203.42@tcp:35:lhsmtool_posix.0 Request processed in 868us (9523us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1789302754.160590:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 14 00000020:00080000:0.0:1789302754.160594:0:14488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789302754.160883:0:16086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789302754.160891:0:16086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.160899:0:16086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68049f9000 already unused, calling callback (ffffffffc145f8b0) 00010000:00010000:2.0:1789302754.160903:0:16086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.160912:0:16086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.160925:0:16086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a69051af900) 00010000:00010000:2.0:1789302754.160928:0:16086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789302754.160933:0:16086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.160940:0:16086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f9000/0x20be524657f12c4a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.160953:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302754.160954:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789302754.160956:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789302754.253506:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302754.268831:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.268954:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484306304 00000100:00100000:0.0:1789302754.268972:0:14484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484306304 00000100:00100000:0.0:1789302754.269035:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789302754.269046:0:14484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+22:14575:x1876219484306304:12345-192.168.203.42@tcp:101:lfs.0 00010000:00010000:0.0:1789302754.269072:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789302754.269104:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x30689f6b364b3bc3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789302754.269214:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789302754.269387:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12c51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bc3 expref: 24 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.269401:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6904039a00) 00010000:00010000:0.0:1789302754.269405:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789302754.269411:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68049f8c00/0x20be524657f12c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.42@tcp remote: 0x30689f6b364b3bc3 expref: 24 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789302754.269425:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68049f8c00, rc 0) 00000100:00100000:0.0:1789302754.269475:0:14484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14575:x1876219484306304:12345-192.168.203.42@tcp:101:lfs.0 Request processed in 432us (654us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1789302754.269482:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 61 00000100:00100000:0.0:1789302754.275808:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:2.0:1789302754.275964:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484306432 00000100:00100000:2.0:1789302754.275974:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484306432 00000100:00100000:2.0:1789302754.276035:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:2.0:1789302754.276060:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14575:x1876219484306432:12345-192.168.203.42@tcp:34:lfs.0 00010000:00010000:2.0:1789302754.276137:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276154:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276167:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276184:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276191:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276198:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276497:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276507:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276515:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789302754.276554:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276568:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276582:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276589:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276596:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f9200 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302754.276600:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276608:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276621:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6907c68000) 00010000:00010000:2.0:1789302754.276624:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302754.276629:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276635:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f9200/0x20be524657f12c5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276648:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276655:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276662:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276668:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8400 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302754.276679:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276687:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276695:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6907c68a00) 00010000:00010000:2.0:1789302754.276698:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302754.276701:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276708:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8400/0x20be524657f12c66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276723:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276730:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276736:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.276741:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a69033f8e00 already unused, calling callback (ffffffffc1e874f0) 00010000:00010000:2.0:1789302754.277002:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.277013:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.277023:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6904039f00) 00010000:00010000:2.0:1789302754.277025:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789302754.277036:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789302754.277042:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a69033f8e00/0x20be524657f12c6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789302754.277232:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14575:x1876219484306432:12345-192.168.203.42@tcp:34:lfs.0 Request processed in 1172us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302754.277240:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 62 00000100:00100000:1.0:1789302754.297637:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.297744:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484306688 00000100:00100000:0.0:1789302754.297764:0:14488:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484306688 00000100:00100000:0.0:1789302754.297824:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:0.0:1789302754.297835:0:14488:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+23:14575:x1876219484306688:12345-192.168.203.42@tcp:35:lfs.0 00000100:00100000:0.0:1789302754.298110:0:14488:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+24:14575:x1876219484306688:12345-192.168.203.42@tcp:35:lfs.0 Request processed in 276us (482us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1789302754.298118:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 15 00000100:00100000:0.0:1789302754.669476:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.669508:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.669530:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.669567:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.669608:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.669635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:0.0:1789302754.669661:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484307200 00000100:00100000:0.0:1789302754.669669:0:14486:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484307200 00000100:00100000:0.0:1789302754.669725:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00100000:0.0:1789302754.669736:0:14486:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2354:x1876219484307200:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:0.0:1789302754.669819:0:14486:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978d6a6b-21a1-4e1a-89ae-c587d417fa88+6:2354:x1876219484307200:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789302754.669827:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 30 00000100:00080000:0.0:1789302754.669850:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789302754.669951:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484306816 00000100:00100000:1.0:1789302754.669964:0:14481:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484306816 00000100:00100000:1.0:1789302754.669999:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:1.0:1789302754.670006:0:14481:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:2354:x1876219484306816:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302754.670045:0:14481:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b16efc0-55ce-4cfe-ad9d-9da090882911+13:2354:x1876219484306816:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 39us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302754.670062:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 123 00000100:00100000:1.0:1789302754.670093:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484307072 00000100:00100000:1.0:1789302754.670097:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484307072 00000100:00100000:1.0:1789302754.670118:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484307328 00000100:00100000:1.0:1789302754.670121:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484307328 00000100:00100000:1.0:1789302754.670134:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484306944 00000100:00100000:1.0:1789302754.670136:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484306944 00000100:00100000:1.0:1789302754.670146:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484307456 00000100:00100000:1.0:1789302754.670148:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484307456 00000100:00100000:1.0:1789302754.670162:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:1.0:1789302754.670169:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2354:x1876219484307072:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302754.670196:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+5:2354:x1876219484307072:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 27us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302754.670202:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 18 00000100:00100000:1.0:1789302754.670214:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:1.0:1789302754.670222:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2354:x1876219484307328:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302754.670242:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2354:x1876219484307328:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 23us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302754.670248:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 19 00000100:00100000:1.0:1789302754.670257:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:1.0:1789302754.670263:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:2354:x1876219484306944:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302754.670322:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:2354:x1876219484306944:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 59us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302754.670328:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:1.0:1789302754.670340:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00100000:1.0:1789302754.670353:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6936346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2354:x1876219484307456:12345-192.168.203.42@tcp:400:kworker.0 00000100:00100000:1.0:1789302754.670388:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6936346a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978d6a6b-21a1-4e1a-89ae-c587d417fa88+5:2354:x1876219484307456:12345-192.168.203.42@tcp:400:kworker.0 Request processed in 36us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302754.670394:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 21 00000100:00080000:0.0:1789302754.670975:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302754.670980:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789302755.281220:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789302756.187612:0:16751:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1789302756.240231:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57a3ba4d-eae9-4780-ad89-641003f4f604:3306:1876219505254784:0@lo:400:kworker.0 00000100:00100000:3.0:1789302756.240344:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302756.240407:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505255296:0@lo:400:kworker.0 00000100:00100000:3.0:1789302756.240436:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302756.240466:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789302756.240472:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505255168:0@lo:400:kworker.0 00000100:00100000:3.0:1789302756.240496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302756.240526:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505254912:0@lo:400:kworker.0 00000100:00100000:3.0:1789302756.240555:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302756.240572:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6902eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505255424:0@lo:400:kworker.0 00000100:00100000:3.0:1789302756.240591:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302756.240610:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789302756.240615:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505255040:0@lo:400:kworker.0 00000100:00100000:3.0:1789302756.240638:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789302756.242589:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505255296 00000100:00100000:3.0:1789302756.242608:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505255296 00000100:00100000:3.0:1789302756.242678:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505255168 00000100:00100000:3.0:1789302756.242688:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505255168 00000100:00100000:3.0:1789302756.242707:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505255424 00000100:00100000:3.0:1789302756.242710:0:14485:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505255424 00000100:00100000:3.0:1789302756.242731:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789302756.242741:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505255296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302756.242846:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876219505255296:12345-0@lo:400:kworker.0 Request processed in 106us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302756.242854:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789302756.242874:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302756.242880:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505255168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789302756.242910:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876219505255168:12345-0@lo:400:kworker.0 Request processed in 30us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302756.242916:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789302756.242928:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789302756.242934:0:14485:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505255424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302756.243374:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505254912 00000100:00100000:1.0:1789302756.243381:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505254912 00000100:00100000:1.0:1789302756.243419:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505255040 00000100:00100000:1.0:1789302756.243423:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505255040 00000100:00100000:1.0:1789302756.243447:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302756.243454:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505254912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302756.243500:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1876219505254912:12345-0@lo:400:kworker.0 Request processed in 47us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302756.243506:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789302756.243518:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302756.243524:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505255040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302756.243549:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505255040:12345-0@lo:400:kworker.0 Request processed in 26us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302756.243555:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789302756.243607:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505255040:0@lo:400:kworker.0 00000100:00100000:1.0:1789302756.243621:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505254912:0@lo:400:kworker.0 00000100:00100000:1.0:1789302756.245274:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505254784 00000100:00100000:1.0:1789302756.245304:0:14479:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505254784 00000100:00100000:1.0:1789302756.245365:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789302756.245389:0:14479:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3306:x1876219505254784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789302756.245470:0:14479:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:57a3ba4d-eae9-4780-ad89-641003f4f604+19:3306:x1876219505254784:12345-0@lo:400:kworker.0 Request processed in 83us (5127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302756.245476:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1789302756.246497:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789302756.246509:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789302756.246515:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789302756.248818:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876219505255168:0@lo:400:kworker.0 00000100:00100000:2.0:1789302756.248838:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6807256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:57a3ba4d-eae9-4780-ad89-641003f4f604:3306:1876219505254784:0@lo:400:kworker.0 00000100:00100000:2.0:1789302756.248851:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1876219505255296:0@lo:400:kworker.0 00000100:00100000:1.0:1789302756.249456:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789302756.249476:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a693c373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505255552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789302756.249559:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302756.249612:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505255552 00000100:00100000:1.0:1789302756.249620:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505255552 00000100:00100000:1.0:1789302756.249671:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302756.249682:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505255552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789302756.249728:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302756.249776:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693beab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876219505255552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302756.249783:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789302756.249830:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a693c373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1876219505255552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789302756.254003:0:14485:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876219505255424:12345-0@lo:400:kworker.0 Request processed in 11052us (13394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789302756.254023:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789302756.255265:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6902eaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1876219505255424:0@lo:400:kworker.0 00010000:00010000:0.0:1789302756.308115:0:16086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789302756.837487:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:1.0:1789302756.842124:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1789302756.844875:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000100:00100000:1.0:1789302757.250971:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:1.0:1789302757.251021:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.42@tcp (source: 12345-192.168.203.42@tcp) 00000100:00100000:3.0:1789302757.251123:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484307584 00000100:00100000:2.0:1789302757.251123:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219484307712 00000100:00100000:3.0:1789302757.251134:0:15173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484307584 00000100:00100000:2.0:1789302757.251134:0:15169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219484307712 00002000:00100000:3.0:1789302757.251212:0:15173:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9a693bea9880 x1876219484307584/t0(0) o4->ec38e548-5fa9-4016-a7ed-50e11bf82d59@192.168.203.42@tcp:333/0 lens 504/0 e 0 to 0 dl 1789302768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789302757.251224:0:15173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a693bea9880 with x1876219484307584 ext(0->8) 00002000:00010000:3.0:1789302757.251231:0:15173:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a693bea9880 00000100:00100000:3.0:1789302757.251258:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 0 00000100:00080000:1.0:1789302757.251303:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789302757.256020:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:2.0:1789302757.256033:0:15169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:2351:x1876219484307712:12345-192.168.203.42@tcp:16:kworker.0 00000100:00100000:2.0:1789302757.256178:0:15169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec38e548-5fa9-4016-a7ed-50e11bf82d59+7:2351:x1876219484307712:12345-192.168.203.42@tcp:16:kworker.0 Request processed in 147us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789302757.256185:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 20 00000100:00100000:3.0:1789302757.260343:0:15173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a693bea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+6:2351:x1876219484307584:12345-192.168.203.42@tcp:4:bash.0 00000100:00100000:1.0:1789302757.261876:0:15173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a693bea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec38e548-5fa9-4016-a7ed-50e11bf82d59+8:2351:x1876219484307584:12345-192.168.203.42@tcp:4:bash.0 Request processed in 10601us (10909us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789302757.261892:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.42@tcp, seq: 0 00002000:00100000:1.0:1789302757.261912:0:15173:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff9a693bea9880 x1876219484307584/t8589934598(0) o4->ec38e548-5fa9-4016-a7ed-50e11bf82d59@192.168.203.42@tcp:333/0 lens 504/448 e 0 to 0 dl 1789302768 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789302757.261921:0:15173:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a693bea9880 with x1876219484307584 ext(0->8) 00002000:00010000:1.0:1789302757.261926:0:15173:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a693bea9880 00010000:00010000:0.0:1789302757.326622:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789302757.773792:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6936346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505255680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789302757.773867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789302757.774006:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219505255680 00000100:00100000:1.0:1789302757.774014:0:15172:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219505255680 00000100:00100000:1.0:1789302757.774071:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789302757.774081:0:15172:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6902eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505255680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789302757.774103:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789302757.774156:0:15172:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6902eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876219505255680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789302757.774163:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789302757.774256:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789302757.774263:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a693c370e00, transno 8589934595 00000004:00080000:0.0:1789302757.774281:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1789302757.774334:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6936346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1876219505255680:0@lo:13:osp-pre-0-0.0 Debug log: 29541 lines, 29541 kept, 0 dropped, 0 bad.